Sep 01 08:07:31 devstack cinder-volume[75896]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 08:07:31 devstack cinder-volume[75896]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 08:07:31 devstack cinder-volume[75896]: we strongly recommend against using it for new projects. Sep 01 08:07:31 devstack cinder-volume[75896]: If you are already using Eventlet, we recommend migrating to a different Sep 01 08:07:31 devstack cinder-volume[75896]: framework. For more detail see Sep 01 08:07:31 devstack cinder-volume[75896]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 08:07:31 devstack cinder-volume[75896]: import eventlet # noqa Sep 01 08:07:34 devstack cinder-volume[75896]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75896) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 08:07:34 devstack cinder-volume[75896]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75896) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 08:07:34 devstack cinder-volume[75896]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75896) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 08:07:35 devstack cinder-volume[75896]: INFO dbcounter [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Registered counter for database cinder Sep 01 08:07:35 devstack cinder-volume[75896]: DEBUG oslo_db.sqlalchemy.engines [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75896) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 08:07:35 devstack cinder-volume[75896]: DEBUG dbcounter [-] [75896] Writer thread running {{(pid=75896) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 08:07:35 devstack cinder-volume[75896]: INFO cinder.rpc [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 08:07:35 devstack cinder-volume[75896]: INFO cinder.rpc [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 08:07:35 devstack cinder-volume[75896]: DEBUG oslo_db.sqlalchemy.engines [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75896) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 08:07:35 devstack cinder-volume[75896]: INFO cinder.volume.manager [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Determined volume DB was empty at startup. Sep 01 08:07:35 devstack cinder-volume[75896]: DEBUG cinder.volume.manager [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75896) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 08:07:35 devstack cinder-volume[75896]: INFO cinder.volume.manager [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 01 08:07:35 devstack cinder-volume[75896]: WARNING stevedore.named [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 08:07:35 devstack cinder-volume[75896]: WARNING castellan.key_manager [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 08:07:35 devstack cinder-volume[75896]: WARNING cinder.keymgr.conf_key_mgr [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG cinder.volume.drivers.lvm [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75896) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_concurrency.processutils [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75896) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_concurrency.processutils [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] CMD "cinder-rtstool verify" returned: 0 in 0.463s {{(pid=75896) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_db.sqlalchemy.engines [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75896) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 08:07:36 devstack cinder-volume[75896]: INFO cinder.rpc [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 01 08:07:36 devstack cinder-volume[75896]: INFO cinder.rpc [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 01 08:07:36 devstack cinder-volume[75896]: WARNING stevedore.named [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 08:07:36 devstack cinder-volume[75896]: WARNING castellan.key_manager [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 08:07:36 devstack cinder-volume[75896]: INFO cinder.volume.manager [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_db.sqlalchemy.engines [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75896) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 08:07:36 devstack cinder-volume[75896]: INFO oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Starting 1 workers Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Started child 76074 {{(pid=75896) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Full set of CONF: {{(pid=75896) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] ******************************************************************************** {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Configuration options gathered from: {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] ================================================================================ {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 08:07:36 devstack cinder-volume[76074]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] allow_availability_zone_fallback = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] allow_compression_on_image_upload = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] allowed_direct_url_schemes = [] {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] api_rate_limit = True {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] auth_strategy = keystone {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] az_cache_duration = 3600 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_availability_zone = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_host = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_name = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_stats_polling_interval = 60 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backup_api_class = cinder.backup.api.API {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backup_name_template = backup-%s {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backup_use_same_host = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backup_use_temp_snapshot = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] chap_password = **** {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] chap_username = {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cinder_internal_tenant_project_id = 802393b924fd42e69130f9bb435a6077 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cinder_internal_tenant_user_id = 4c5318204c3a450b957b42fdf0484c8a {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cloned_volume_same_az = True {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cluster = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] compression_format = gzip {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] compute_api_class = cinder.compute.nova.API {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] config_dir = [] {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] config_source = [] {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] control_exchange = openstack {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] debug = True {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] default_availability_zone = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] default_group_type = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] default_volume_type = lvmdriver-1 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] disk_geometry = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] driver_client_cert = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] driver_client_cert_key = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] driver_data_namespace = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] driver_ssl_cert_path = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] driver_ssl_cert_verify = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] driver_use_ssl = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] enable_force_upload = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] enable_new_services = True {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] enable_unsupported_driver = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] enforce_multipath_for_image_xfer = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] filter_function = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] glance_api_insecure = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] glance_api_servers = ['http://192.168.122.100/image'] {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] glance_api_ssl_compression = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] glance_ca_certificates_file = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] glance_catalog_info = image:glance:publicURL {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] glance_certfile = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] glance_keyfile = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] glance_num_retries = 3 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] glance_request_timeout = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] goodness_function = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] graceful_shutdown_timeout = 5 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] group_api_class = cinder.group.api.API {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] host = devstack {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] image_compress_on_upload = True {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] image_conversion_address_space_limit = 1 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] image_conversion_cpu_limit = 60 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] image_conversion_disable = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] image_upload_use_cinder_backend = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] image_upload_use_internal_tenant = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] image_volume_cache_enabled = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] image_volume_cache_max_count = 0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] image_volume_cache_max_size_gb = 0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] init_host_max_objects_retrieval = 0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[76074]: INFO cinder.volume.manager [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] instance_format = [instance: %(uuid)s] {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] iscsi_target_flags = {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] iscsi_write_cache = on {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] iser_helper = tgtadm {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] iser_ip_address = 192.168.122.100 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] iser_port = 3260 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] log_color = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] log_config_append = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] log_dir = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] log_file = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] log_options = True {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] log_rotate_interval = 1 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] log_rotate_interval_type = days {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] log_rotation_type = none {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] max_age = 0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] max_logfile_count = 30 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] max_logfile_size_mb = 200 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] max_over_subscription_ratio = 20.0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] message_reap_interval = 86400 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] message_ttl = 2592000 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] migration_create_volume_timeout_secs = 300 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] monkey_patch = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] monkey_patch_modules = [] {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] my_ip = 192.168.122.100 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] no_snapshot_gb_quota = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] num_iser_scan_tries = 3 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] num_shell_tries = 3 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] num_volume_device_scan_tries = 3 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] nvmeof_conn_info_version = 1 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] nvmet_ns_id = 10 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] nvmet_port_id = 1 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] osapi_max_limit = 1000 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] osapi_volume_ext_list = [] {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] osapi_volume_listen_port = 8776 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] osapi_volume_use_ssl = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] osapi_volume_workers = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] per_volume_size_limit = -1 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] periodic_fuzzy_delay = 60 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] periodic_interval = 60 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] public_endpoint = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] publish_errors = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] quota_backup_gigabytes = 1000 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] quota_backups = 10 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] quota_gigabytes = 1000 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] quota_groups = 10 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] quota_snapshots = 10 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] quota_volumes = 10 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] rate_limit_burst = 0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] rate_limit_except_level = CRITICAL {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] rate_limit_interval = 0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] reinit_driver_count = 3 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] replication_device = **** {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] report_discard_supported = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] report_interval = 120 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] reservation_clean_interval = 86400 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] reservation_expire = 86400 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] reserved_image_namespaces = [] {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] reserved_percentage = 0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] rpc_response_timeout = 120 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] run_external_periodic_tasks = True {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] scst_target_driver = iscsi {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] scst_target_iqn_name = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] service_down_time = 720 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] shell_completion = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] snapshot_name_template = snapshot-%s {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] snapshot_same_host = True {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] split_loggers = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] state_path = /opt/stack/data/cinder {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] storage_availability_zone = nova {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] storage_protocol = iSCSI {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] syslog_log_facility = LOG_USER {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] target_helper = lioadm {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] target_ip_address = 192.168.122.100 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] target_port = 3260 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] target_protocol = iscsi {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] target_secondary_ip_addresses = [] {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] trace_flags = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] transport_url = **** {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] until_refresh = 0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] use_chap_auth = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] use_default_quota_class = True {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] use_journal = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] use_json = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] use_multipath_for_image_xfer = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] use_stderr = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] use_syslog = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] verify_glance_signatures = enabled {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] volume_api_class = cinder.volume.api.API {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] volume_backend_name = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] volume_clear = zero {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] volume_clear_ionice = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] volume_clear_size = 0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] volume_copy_bps_limit = 0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] volume_dd_blocksize = 1M {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] volume_name_template = volume-%s {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] volume_service_inithost_offload = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] volume_usage_audit_period = month {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] zoning_mode = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_concurrency.disable_process_locking = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.auth_section = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.auth_type = password {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.auth_version = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.cache = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.certfile = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.include_service_catalog = True {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.insecure = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.interface = public {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.keyfile = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.memcache_password = **** {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.memcache_username = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.region_name = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.service_type = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.100/identity {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.backend = dogpile.cache.null {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.backend_argument = **** {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.backend_expiration_time = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.config_prefix = cache.oslo {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.debug_cache_backend = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.enable_retry_client = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.enable_socket_keepalive = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.enabled = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.expiration_time = 600 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.hashclient_retry_attempts = 2 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.memcache_dead_retry = 300 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.memcache_pool_maxsize = 10 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.memcache_sasl_enabled = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.password = **** {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.proxies = [] {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.redis_db = 0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.redis_server = localhost:6379 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.retry_attempts = 2 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.retry_delay = 0.0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.socket_keepalive_count = 1 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.socket_keepalive_idle = 1 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.socket_keepalive_interval = 1 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.socket_timeout = 1.0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.tls_allowed_ciphers = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.tls_cafile = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.tls_certfile = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.tls_enabled = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.tls_keyfile = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cache.username = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] coordination.backend_url = **** {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] database.asyncio_connection = **** {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] database.asyncio_slave_connection = **** {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] database.backend = sqlalchemy {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] database.connection = **** {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] database.connection_debug = 0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] database.connection_parameters = {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] database.connection_recycle_time = 3600 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] database.connection_trace = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] database.db_inc_retry_interval = True {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] database.db_max_retries = 20 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] database.db_max_retry_interval = 10 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] database.db_retry_interval = 1 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] database.max_overflow = 50 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] database.max_pool_size = 5 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] database.max_retries = 10 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack sudo[76122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] database.mysql_wsrep_sync_wait = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack sudo[76122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] database.pool_timeout = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] database.retry_interval = 10 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] database.slave_connection = **** {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] database.sqlite_synchronous = True {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] database.synchronous_reader = True {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] database.use_db_reconnect = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_tracing.insecure = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] profiler.connection_string = messaging:// {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] profiler.enabled = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] profiler.es_doc_type = notification {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] profiler.es_scroll_size = 10000 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] profiler.es_scroll_time = 2m {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] profiler.filter_error_trace = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] profiler.hmac_keys = **** {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] profiler.sentinel_service_name = mymaster {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] profiler.socket_timeout = 0.1 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] profiler.trace_requests = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] profiler.trace_sqlalchemy = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] profiler_jaeger.process_tags = {} {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] profiler_jaeger.service_name_prefix = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] profiler_otlp.service_name_prefix = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_policy.enforce_new_defaults = True {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_policy.policy_default_rule = default {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_policy.policy_file = policy.yaml {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] privsep_osbrick.group = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] privsep_osbrick.helper_command = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] privsep_osbrick.user = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cinder_sys_admin.group = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cinder_sys_admin.helper_command = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] cinder_sys_admin.user = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] service_user.auth_section = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] service_user.auth_type = password {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] service_user.cafile = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] service_user.certfile = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] service_user.collect_timing = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] service_user.insecure = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] service_user.keyfile = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] service_user.send_service_user_token = True {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] service_user.split_loggers = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] service_user.timeout = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] glance.auth_section = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] glance.auth_type = password {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] glance.certfile = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] glance.collect_timing = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] glance.insecure = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] glance.keyfile = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] glance.region_name = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] glance.split_loggers = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] glance.timeout = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.backend_availability_zone = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.chap_password = **** {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.chap_username = {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.disk_geometry = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.driver_client_cert = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.driver_client_cert_key = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.driver_data_namespace = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.driver_use_ssl = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.extra_capabilities = {} {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.filter_function = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.goodness_function = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.iscsi_target_flags = {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.iscsi_write_cache = on {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.iser_helper = tgtadm {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.iser_ip_address = 192.168.122.100 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.iser_port = 3260 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.lvm_share_target = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.lvm_type = auto {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.num_shell_tries = 3 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.replication_device = **** {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.report_discard_supported = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.reserved_percentage = 0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.target_helper = tgtadm {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.target_ip_address = 192.168.122.100 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.target_port = 3260 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.target_protocol = iscsi {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.trace_flags = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.unique_fqdn_network = True {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.use_chap_auth = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.volume_backend_name = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.volume_clear = zero {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.volume_clear_ionice = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.volume_clear_size = 0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_reports.file_event_handler = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_reports.log_dir = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.backend_host = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.chap_password = **** {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.chap_username = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.disk_geometry = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.driver_client_cert = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.extra_capabilities = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.filter_function = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.goodness_function = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.iser_helper = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.iser_ip_address = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.iser_port = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.lvm_share_target = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.lvm_type = auto {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.num_shell_tries = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.replication_device = **** {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.report_discard_supported = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.reserved_percentage = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.scst_target_driver = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.storage_protocol = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:36 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.target_helper = lioadm {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.target_ip_address = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.target_port = 3260 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.trace_flags = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.use_chap_auth = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.volume_clear = zero {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.volume_clear_size = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] lvmdriver-1.volumes_dir = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.ssl = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_notifications.driver = [] {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_notifications.retry = -1 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] key_manager.fixed_key = **** {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] barbican.barbican_api_version = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] barbican.barbican_endpoint = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] barbican.barbican_endpoint_type = public {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] barbican.barbican_region_name = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] barbican.cafile = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] barbican.certfile = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] barbican.collect_timing = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] barbican.insecure = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] barbican.keyfile = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] barbican.number_of_retries = 60 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] barbican.retry_delay = 1 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] barbican.send_service_user_token = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] barbican.split_loggers = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] barbican.timeout = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] barbican.verify_ssl = True {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] barbican.verify_ssl_path = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] barbican_service_user.auth_section = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] barbican_service_user.auth_type = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] barbican_service_user.cafile = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] barbican_service_user.certfile = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] barbican_service_user.collect_timing = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] barbican_service_user.insecure = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] barbican_service_user.keyfile = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] barbican_service_user.split_loggers = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] barbican_service_user.timeout = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] vault.approle_role_id = **** {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] vault.approle_secret_id = **** {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] vault.auth_method = approle {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] vault.auth_path = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] vault.kv_mountpoint = secret {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] vault.kv_path = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] vault.kv_version = 2 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] vault.namespace = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] vault.root_token_id = **** {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] vault.ssl_ca_crt_file = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] vault.timeout = 60.0 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] vault.token_file = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] vault.token_role = None {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] vault.use_ssl = False {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:07:37 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] ******************************************************************************** {{(pid=75896) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 08:07:37 devstack sudo[76122]: pam_unix(sudo:session): session closed for user root Sep 01 08:07:37 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:37 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:37 devstack sudo[76270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 08:07:37 devstack sudo[76270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:07:37 devstack sudo[76270]: pam_unix(sudo:session): session closed for user root Sep 01 08:07:37 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.253s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:37 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 08:07:37 devstack cinder-volume[76074]: INFO cinder.brick.local_dev.lvm [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 01 08:07:37 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:37 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:37 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:37 devstack sudo[76361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 08:07:37 devstack sudo[76361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:07:37 devstack sudo[76361]: pam_unix(sudo:session): session closed for user root Sep 01 08:07:37 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:37 devstack cinder-volume[76074]: DEBUG cinder.brick.local_dev.lvm [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76074) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 01 08:07:37 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:37 devstack sudo[76443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 08:07:37 devstack sudo[76443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:07:39 devstack sudo[76443]: pam_unix(sudo:session): session closed for user root Sep 01 08:07:39 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.614s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:39 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:39 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:39 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:39 devstack sudo[76758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 08:07:39 devstack sudo[76758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:07:39 devstack sudo[76758]: pam_unix(sudo:session): session closed for user root Sep 01 08:07:39 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.306s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:39 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:39 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:39 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:39 devstack sudo[76828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 01 08:07:39 devstack sudo[76828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:07:39 devstack sudo[76828]: pam_unix(sudo:session): session closed for user root Sep 01 08:07:39 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.253s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:39 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:39 devstack sudo[76831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 08:07:39 devstack sudo[76831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:07:40 devstack sudo[76831]: pam_unix(sudo:session): session closed for user root Sep 01 08:07:40 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:40 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:40 devstack sudo[76834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 08:07:40 devstack sudo[76834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:07:40 devstack sudo[76834]: pam_unix(sudo:session): session closed for user root Sep 01 08:07:40 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:40 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:40 devstack sudo[76837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 08:07:40 devstack sudo[76837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:07:40 devstack sudo[76837]: pam_unix(sudo:session): session closed for user root Sep 01 08:07:40 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:40 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:40 devstack sudo[76840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 08:07:40 devstack sudo[76840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:07:40 devstack sudo[76840]: pam_unix(sudo:session): session closed for user root Sep 01 08:07:40 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:40 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:40 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:40 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:41 devstack sudo[76844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 08:07:41 devstack sudo[76844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:07:41 devstack sudo[76844]: pam_unix(sudo:session): session closed for user root Sep 01 08:07:41 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:41 devstack cinder-volume[76074]: INFO cinder.volume.drivers.lvm [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 01 08:07:41 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:41 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:41 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:41 devstack sudo[76848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 08:07:41 devstack sudo[76848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:07:41 devstack sudo[76848]: pam_unix(sudo:session): session closed for user root Sep 01 08:07:41 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:41 devstack cinder-volume[76074]: DEBUG cinder.volume.drivers.lvm [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Updating volume stats {{(pid=76074) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 08:07:41 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:41 devstack sudo[76854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 08:07:41 devstack sudo[76854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:07:41 devstack sudo[76854]: pam_unix(sudo:session): session closed for user root Sep 01 08:07:41 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:41 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:41 devstack sudo[76857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 08:07:41 devstack sudo[76857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:07:42 devstack sudo[76857]: pam_unix(sudo:session): session closed for user root Sep 01 08:07:42 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:42 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:42 devstack sudo[76860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 08:07:42 devstack sudo[76860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:07:42 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:42 devstack sudo[76860]: pam_unix(sudo:session): session closed for user root Sep 01 08:07:42 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:42 devstack sudo[76863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 08:07:42 devstack sudo[76863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:07:42 devstack sudo[76863]: pam_unix(sudo:session): session closed for user root Sep 01 08:07:42 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:42 devstack cinder-volume[76074]: INFO cinder.volume.driver [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Driver hasn't implemented _init_vendor_properties() Sep 01 08:07:42 devstack cinder-volume[76074]: DEBUG cinder.volume.driver [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76074) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 08:07:42 devstack cinder-volume[76074]: DEBUG oslo_db.sqlalchemy.engines [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76074) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 08:07:42 devstack cinder-volume[76074]: DEBUG dbcounter [-] [76074] Writer thread running {{(pid=76074) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 08:07:42 devstack cinder-volume[76074]: DEBUG cinder.db.api [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Building query based on filter {{(pid=76074) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 08:07:42 devstack cinder-volume[76074]: DEBUG cinder.image.image_utils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76074) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 08:07:42 devstack cinder-volume[76074]: INFO cinder.keymgr.migration [None req-a19063bd-39be-4310-881b-50e2207de8f2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 08:07:42 devstack cinder-volume[76074]: DEBUG cinder.volume.drivers.lvm [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Updating volume stats {{(pid=76074) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 08:07:42 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:42 devstack sudo[76872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 08:07:42 devstack sudo[76872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:07:43 devstack sudo[76872]: pam_unix(sudo:session): session closed for user root Sep 01 08:07:43 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:43 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:43 devstack sudo[76875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 08:07:43 devstack sudo[76875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:07:43 devstack sudo[76875]: pam_unix(sudo:session): session closed for user root Sep 01 08:07:43 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:43 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:43 devstack sudo[76878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 08:07:43 devstack sudo[76878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:07:43 devstack sudo[76878]: pam_unix(sudo:session): session closed for user root Sep 01 08:07:43 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:43 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:43 devstack sudo[76882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 08:07:43 devstack sudo[76882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:07:43 devstack sudo[76882]: pam_unix(sudo:session): session closed for user root Sep 01 08:07:43 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:43 devstack cinder-volume[76074]: DEBUG cinder.manager [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Notifying Schedulers of capabilities ... {{(pid=76074) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:07:43 devstack cinder-volume[76074]: INFO cinder.volume.manager [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Driver initialization completed successfully. Sep 01 08:07:43 devstack cinder-volume[76074]: INFO cinder.manager [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Initiating service 2 cleanup Sep 01 08:07:43 devstack cinder-volume[76074]: INFO cinder.manager [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Service 2 cleanup completed. Sep 01 08:07:43 devstack cinder-volume[76074]: DEBUG cinder.service [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Creating RPC server for service cinder-volume {{(pid=76074) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 08:07:43 devstack cinder-volume[76074]: DEBUG cinder.service [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76074) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 08:07:44 devstack cinder-volume[76074]: INFO cinder.volume.manager [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 01 08:07:44 devstack cinder-volume[76074]: DEBUG cinder.volume.drivers.lvm [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Updating volume stats {{(pid=76074) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 08:07:44 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:44 devstack sudo[76885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 08:07:44 devstack sudo[76885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:07:44 devstack sudo[76885]: pam_unix(sudo:session): session closed for user root Sep 01 08:07:44 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:44 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:44 devstack sudo[76889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 08:07:44 devstack sudo[76889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:07:44 devstack sudo[76889]: pam_unix(sudo:session): session closed for user root Sep 01 08:07:44 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:44 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:44 devstack sudo[76897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 08:07:44 devstack sudo[76897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:07:45 devstack sudo[76897]: pam_unix(sudo:session): session closed for user root Sep 01 08:07:45 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.427s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:45 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:07:45 devstack sudo[76985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 08:07:45 devstack sudo[76985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:07:45 devstack sudo[76985]: pam_unix(sudo:session): session closed for user root Sep 01 08:07:45 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:07:45 devstack cinder-volume[76074]: INFO cinder.volume.manager [None req-79c3a332-52ae-4e44-b1c6-84d46a0cdfd7 None None] Driver post RPC initialization completed successfully. Sep 01 08:07:46 devstack cinder-volume[75896]: DEBUG dbcounter [-] [75896] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75896) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:07:55 devstack cinder-volume[76074]: DEBUG dbcounter [-] [76074] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76074) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:07:55 devstack cinder-volume[76074]: DEBUG dbcounter [-] [76074] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76074) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:08:42 devstack cinder-volume[76074]: DEBUG oslo_service.periodic_task [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76074) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:08:42 devstack cinder-volume[76074]: DEBUG cinder.volume.drivers.lvm [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] Updating volume stats {{(pid=76074) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 08:08:42 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:08:42 devstack sudo[78897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 08:08:42 devstack sudo[78897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:08:42 devstack sudo[78897]: pam_unix(sudo:session): session closed for user root Sep 01 08:08:42 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:08:42 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:08:42 devstack sudo[78900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 08:08:42 devstack sudo[78900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:08:42 devstack sudo[78900]: pam_unix(sudo:session): session closed for user root Sep 01 08:08:42 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:08:42 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:08:42 devstack sudo[78921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 08:08:42 devstack sudo[78921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:08:43 devstack sudo[78921]: pam_unix(sudo:session): session closed for user root Sep 01 08:08:43 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:08:43 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:08:43 devstack sudo[78924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 08:08:43 devstack sudo[78924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:08:43 devstack sudo[78924]: pam_unix(sudo:session): session closed for user root Sep 01 08:08:43 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:08:43 devstack cinder-volume[76074]: DEBUG cinder.manager [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] Notifying Schedulers of capabilities ... {{(pid=76074) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:08:43 devstack cinder-volume[76074]: DEBUG oslo_service.periodic_task [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] Running periodic task VolumeManager._thread_info {{(pid=76074) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:08:43 devstack cinder-volume[76074]: DEBUG cinder.volume.manager [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] thread count: 6 {{(pid=76074) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 08:08:43 devstack cinder-volume[76074]: DEBUG cinder.volume.manager [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] thread info: [<_MainThread(MainThread, started 125244410781824)>, , , , , ] {{(pid=76074) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 08:09:42 devstack cinder-volume[76074]: DEBUG oslo_service.periodic_task [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76074) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:09:42 devstack cinder-volume[76074]: DEBUG cinder.volume.drivers.lvm [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] Updating volume stats {{(pid=76074) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 08:09:42 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:09:42 devstack sudo[82203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 08:09:42 devstack sudo[82203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:09:42 devstack sudo[82203]: pam_unix(sudo:session): session closed for user root Sep 01 08:09:42 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:09:42 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:09:42 devstack sudo[82206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 08:09:42 devstack sudo[82206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:09:42 devstack sudo[82206]: pam_unix(sudo:session): session closed for user root Sep 01 08:09:42 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:09:42 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:09:42 devstack sudo[82216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 08:09:42 devstack sudo[82216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:09:43 devstack sudo[82216]: pam_unix(sudo:session): session closed for user root Sep 01 08:09:43 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.243s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:09:43 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:09:43 devstack sudo[82219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 08:09:43 devstack sudo[82219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:09:43 devstack sudo[82219]: pam_unix(sudo:session): session closed for user root Sep 01 08:09:43 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:09:43 devstack cinder-volume[76074]: DEBUG cinder.manager [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] Notifying Schedulers of capabilities ... {{(pid=76074) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:09:43 devstack cinder-volume[76074]: DEBUG oslo_service.periodic_task [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] Running periodic task VolumeManager._thread_info {{(pid=76074) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:09:43 devstack cinder-volume[76074]: DEBUG cinder.volume.manager [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] thread count: 6 {{(pid=76074) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 08:09:43 devstack cinder-volume[76074]: DEBUG cinder.volume.manager [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] thread info: [<_MainThread(MainThread, started 125244410781824)>, , , , , ] {{(pid=76074) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 08:09:55 devstack cinder-volume[76074]: DEBUG dbcounter [-] [76074] Writing DB stats cinder:SELECT=1 {{(pid=76074) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:09:55 devstack cinder-volume[76074]: DEBUG dbcounter [-] [76074] Writing DB stats cinder:UPDATE=1 {{(pid=76074) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:10:42 devstack cinder-volume[76074]: DEBUG oslo_service.periodic_task [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76074) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:10:42 devstack cinder-volume[76074]: DEBUG cinder.volume.drivers.lvm [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] Updating volume stats {{(pid=76074) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 08:10:42 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:10:42 devstack sudo[84295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 08:10:42 devstack sudo[84295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:10:42 devstack sudo[84295]: pam_unix(sudo:session): session closed for user root Sep 01 08:10:42 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:10:42 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:10:42 devstack sudo[84307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 08:10:42 devstack sudo[84307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:10:42 devstack sudo[84307]: pam_unix(sudo:session): session closed for user root Sep 01 08:10:42 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:10:42 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:10:42 devstack sudo[84310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 08:10:42 devstack sudo[84310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:10:43 devstack sudo[84310]: pam_unix(sudo:session): session closed for user root Sep 01 08:10:43 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:10:43 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:10:43 devstack sudo[84313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 08:10:43 devstack sudo[84313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:10:43 devstack sudo[84313]: pam_unix(sudo:session): session closed for user root Sep 01 08:10:43 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:10:43 devstack cinder-volume[76074]: DEBUG cinder.manager [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] Notifying Schedulers of capabilities ... {{(pid=76074) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:10:43 devstack cinder-volume[76074]: DEBUG oslo_service.periodic_task [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] Running periodic task VolumeManager._thread_info {{(pid=76074) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:10:43 devstack cinder-volume[76074]: DEBUG cinder.volume.manager [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] thread count: 6 {{(pid=76074) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 08:10:43 devstack cinder-volume[76074]: DEBUG cinder.volume.manager [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] thread info: [<_MainThread(MainThread, started 125244410781824)>, , , , , ] {{(pid=76074) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 08:11:42 devstack cinder-volume[76074]: DEBUG oslo_service.periodic_task [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76074) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:11:42 devstack cinder-volume[76074]: DEBUG cinder.volume.drivers.lvm [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] Updating volume stats {{(pid=76074) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 08:11:42 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:11:42 devstack sudo[85562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 08:11:42 devstack sudo[85562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:11:42 devstack sudo[85562]: pam_unix(sudo:session): session closed for user root Sep 01 08:11:42 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:11:42 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:11:42 devstack sudo[85587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 08:11:42 devstack sudo[85587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:11:42 devstack sudo[85587]: pam_unix(sudo:session): session closed for user root Sep 01 08:11:42 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:11:42 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:11:42 devstack sudo[85590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 08:11:42 devstack sudo[85590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:11:43 devstack sudo[85590]: pam_unix(sudo:session): session closed for user root Sep 01 08:11:43 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:11:43 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:11:43 devstack sudo[85598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 08:11:43 devstack sudo[85598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:11:43 devstack sudo[85598]: pam_unix(sudo:session): session closed for user root Sep 01 08:11:43 devstack cinder-volume[76074]: DEBUG oslo_concurrency.processutils [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:11:43 devstack cinder-volume[76074]: DEBUG cinder.manager [None req-b0535de2-701a-44d7-abf0-486aec55316e None None] Notifying Schedulers of capabilities ... {{(pid=76074) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:11:55 devstack cinder-volume[76074]: DEBUG dbcounter [-] [76074] Writing DB stats cinder:SELECT=1 {{(pid=76074) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:11:55 devstack cinder-volume[76074]: DEBUG dbcounter [-] [76074] Writing DB stats cinder:UPDATE=1 {{(pid=76074) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:11:57 devstack cinder-volume[75896]: INFO oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Caught SIGTERM, stopping children Sep 01 08:11:57 devstack cinder-volume[75896]: DEBUG oslo_concurrency.lockutils [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Acquiring lock "singleton_lock" {{(pid=75896) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 08:11:57 devstack cinder-volume[75896]: DEBUG oslo_concurrency.lockutils [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Acquired lock "singleton_lock" {{(pid=75896) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 08:11:57 devstack cinder-volume[75896]: DEBUG oslo_concurrency.lockutils [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Releasing lock "singleton_lock" {{(pid=75896) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 08:11:57 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Stop services. {{(pid=75896) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 01 08:11:57 devstack cinder-volume[75896]: DEBUG oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Killing children. {{(pid=75896) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 01 08:11:57 devstack cinder-volume[75896]: INFO oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Waiting on 1 children to exit Sep 01 08:11:59 devstack cinder-volume[76074]: DEBUG oslo_concurrency.lockutils [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Acquiring lock "singleton_lock" {{(pid=76074) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 08:11:59 devstack cinder-volume[76074]: DEBUG oslo_concurrency.lockutils [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Acquired lock "singleton_lock" {{(pid=76074) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 08:11:59 devstack cinder-volume[76074]: DEBUG oslo_concurrency.lockutils [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Releasing lock "singleton_lock" {{(pid=76074) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 08:11:59 devstack cinder-volume[76074]: WARNING amqp [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 08:11:59 devstack cinder-volume[76074]: WARNING amqp [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 08:11:59 devstack cinder-volume[75896]: INFO oslo_service.backend._eventlet.service [None req-1fb98669-b4ac-4c66-8ba4-f61671f4f061 None None] Child 76074 exited with status 0 Sep 01 08:11:59 devstack cinder-volume[86061]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 08:11:59 devstack cinder-volume[86061]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 08:11:59 devstack cinder-volume[86061]: we strongly recommend against using it for new projects. Sep 01 08:11:59 devstack cinder-volume[86061]: If you are already using Eventlet, we recommend migrating to a different Sep 01 08:11:59 devstack cinder-volume[86061]: framework. For more detail see Sep 01 08:11:59 devstack cinder-volume[86061]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 08:11:59 devstack cinder-volume[86061]: import eventlet # noqa Sep 01 08:12:01 devstack cinder-volume[86061]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86061) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 08:12:01 devstack cinder-volume[86061]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86061) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 08:12:01 devstack cinder-volume[86061]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86061) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 08:12:02 devstack cinder-volume[86061]: INFO dbcounter [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] Registered counter for database cinder Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_db.sqlalchemy.engines [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86061) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG dbcounter [-] [86061] Writer thread running {{(pid=86061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 08:12:02 devstack cinder-volume[86061]: INFO cinder.rpc [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 08:12:02 devstack cinder-volume[86061]: INFO cinder.rpc [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_db.sqlalchemy.engines [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86061) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 08:12:02 devstack cinder-volume[86061]: INFO cinder.volume.manager [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] Determined volume DB was empty at startup. Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG cinder.volume.manager [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86061) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 08:12:02 devstack cinder-volume[86061]: INFO cinder.volume.manager [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 01 08:12:02 devstack cinder-volume[86061]: WARNING stevedore.named [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 08:12:02 devstack cinder-volume[86061]: WARNING castellan.key_manager [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 08:12:02 devstack cinder-volume[86061]: WARNING cinder.keymgr.conf_key_mgr [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 08:12:02 devstack cinder-volume[86061]: INFO cinder.volume.manager [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_db.sqlalchemy.engines [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86061) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 08:12:02 devstack cinder-volume[86061]: INFO oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] Starting 1 workers Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] Started child 86275 {{(pid=86061) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] Full set of CONF: {{(pid=86061) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] ******************************************************************************** {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] Configuration options gathered from: {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] ================================================================================ {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 08:12:02 devstack cinder-volume[86275]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] allow_availability_zone_fallback = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] allow_compression_on_image_upload = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] allowed_direct_url_schemes = [] {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] api_rate_limit = True {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] auth_strategy = keystone {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_availability_zone = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_host = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_name = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_stats_polling_interval = 60 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backup_api_class = cinder.backup.api.API {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backup_name_template = backup-%s {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backup_use_same_host = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backup_use_temp_snapshot = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] chap_password = **** {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] chap_username = {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cinder_internal_tenant_project_id = 802393b924fd42e69130f9bb435a6077 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cinder_internal_tenant_user_id = 4c5318204c3a450b957b42fdf0484c8a {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cluster = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] compression_format = gzip {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] compute_api_class = cinder.compute.nova.API {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] config_dir = [] {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] config_source = [] {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] control_exchange = openstack {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] debug = True {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] default_availability_zone = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] default_group_type = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] default_volume_type = QuobyteHD {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] disk_geometry = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] driver_client_cert = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] driver_client_cert_key = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] driver_data_namespace = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] driver_ssl_cert_path = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] driver_ssl_cert_verify = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] driver_use_ssl = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] enable_new_services = True {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] enable_unsupported_driver = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] enabled_backends = ['QuobyteHD'] {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] enforce_multipath_for_image_xfer = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86275]: INFO cinder.volume.manager [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 01 08:12:02 devstack cinder-volume[86275]: DEBUG cinder.volume.drivers.remotefs [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86275) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] filter_function = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] glance_api_insecure = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] glance_api_servers = ['http://192.168.122.100/image'] {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] glance_api_ssl_compression = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] glance_ca_certificates_file = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] glance_catalog_info = image:glance:publicURL {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] glance_certfile = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] glance_keyfile = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] glance_num_retries = 3 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] glance_request_timeout = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] goodness_function = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] graceful_shutdown_timeout = 5 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] group_api_class = cinder.group.api.API {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] host = devstack {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] image_compress_on_upload = True {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] image_conversion_address_space_limit = 1 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] image_conversion_cpu_limit = 60 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] image_conversion_disable = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] image_upload_use_cinder_backend = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] image_upload_use_internal_tenant = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] image_volume_cache_enabled = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] image_volume_cache_max_count = 0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] image_volume_cache_max_size_gb = 0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] init_host_max_objects_retrieval = 0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] instance_format = [instance: %(uuid)s] {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] iscsi_target_flags = {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] iscsi_write_cache = on {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] iser_helper = tgtadm {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] iser_ip_address = 192.168.122.100 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] iser_port = 3260 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] log_color = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] log_config_append = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] log_dir = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] log_file = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] log_options = True {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] log_rotate_interval = 1 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] log_rotate_interval_type = days {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] log_rotation_type = none {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] max_age = 0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] max_logfile_count = 30 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] max_logfile_size_mb = 200 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] max_over_subscription_ratio = 20.0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] message_reap_interval = 86400 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] message_ttl = 2592000 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] migration_create_volume_timeout_secs = 300 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] monkey_patch = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] monkey_patch_modules = [] {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] my_ip = 192.168.122.100 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] no_snapshot_gb_quota = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] num_iser_scan_tries = 3 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] num_shell_tries = 3 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] num_volume_device_scan_tries = 3 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] nvmeof_conn_info_version = 1 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] nvmet_ns_id = 10 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] nvmet_port_id = 1 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86275]: DEBUG cinder.volume.drivers.quobyte [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86275) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 01 08:12:02 devstack cinder-volume[86275]: WARNING cinder.volume.drivers.quobyte [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 01 08:12:02 devstack cinder-volume[86275]: WARNING cinder.volume.drivers.quobyte [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] osapi_max_limit = 1000 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] osapi_volume_ext_list = [] {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86275]: DEBUG oslo_concurrency.processutils [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Running cmd (subprocess): mount.quobyte {{(pid=86275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] osapi_volume_listen_port = 8776 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] osapi_volume_use_ssl = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] osapi_volume_workers = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] per_volume_size_limit = -1 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] periodic_fuzzy_delay = 60 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] periodic_interval = 60 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] public_endpoint = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] publish_errors = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] quota_backup_gigabytes = 1000 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] quota_backups = 10 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] quota_gigabytes = 1000 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] quota_groups = 10 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] quota_snapshots = 10 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] quota_volumes = 10 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] rate_limit_burst = 0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] rate_limit_except_level = CRITICAL {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] rate_limit_interval = 0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] reinit_driver_count = 3 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] replication_device = **** {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] report_discard_supported = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] report_interval = 120 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] reservation_clean_interval = 86400 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] reservation_expire = 86400 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] reserved_image_namespaces = [] {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] reserved_percentage = 0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] rpc_response_timeout = 120 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] run_external_periodic_tasks = True {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] scst_target_driver = iscsi {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] scst_target_iqn_name = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] service_down_time = 720 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] shell_completion = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] snapshot_name_template = snapshot-%s {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] split_loggers = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] state_path = /opt/stack/data/cinder {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] storage_availability_zone = nova {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] storage_protocol = iSCSI {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] syslog_log_facility = LOG_USER {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] target_helper = lioadm {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] target_ip_address = 192.168.122.100 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] target_port = 3260 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] target_protocol = iscsi {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] target_secondary_ip_addresses = [] {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] trace_flags = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] transport_url = **** {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] until_refresh = 0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] use_chap_auth = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] use_default_quota_class = True {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] use_journal = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] use_json = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] use_multipath_for_image_xfer = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] use_stderr = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] use_syslog = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] verify_glance_signatures = enabled {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] volume_api_class = cinder.volume.api.API {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] volume_backend_name = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] volume_clear = zero {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] volume_clear_ionice = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] volume_clear_size = 0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] volume_copy_bps_limit = 0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] volume_dd_blocksize = 1M {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] volume_name_template = volume-%s {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] volume_service_inithost_offload = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] volume_usage_audit_period = month {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] zoning_mode = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_concurrency.disable_process_locking = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.auth_section = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.auth_type = password {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.auth_version = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.cache = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.certfile = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.include_service_catalog = True {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.insecure = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.interface = public {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.keyfile = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.memcache_password = **** {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.memcache_username = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.region_name = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.service_type = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.100/identity {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.backend = dogpile.cache.null {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.backend_argument = **** {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.backend_expiration_time = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.config_prefix = cache.oslo {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.debug_cache_backend = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.enable_retry_client = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.enable_socket_keepalive = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.enabled = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.expiration_time = 600 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.hashclient_retry_attempts = 2 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.memcache_dead_retry = 300 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.memcache_pool_maxsize = 10 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.memcache_sasl_enabled = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.password = **** {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.proxies = [] {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.redis_db = 0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.redis_server = localhost:6379 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.retry_attempts = 2 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.retry_delay = 0.0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.socket_keepalive_count = 1 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.socket_keepalive_idle = 1 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.socket_keepalive_interval = 1 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.socket_timeout = 1.0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.tls_allowed_ciphers = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.tls_cafile = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.tls_certfile = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.tls_enabled = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.tls_keyfile = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cache.username = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] coordination.backend_url = **** {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] database.asyncio_connection = **** {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] database.asyncio_slave_connection = **** {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] database.backend = sqlalchemy {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] database.connection = **** {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] database.connection_debug = 0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] database.connection_parameters = {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] database.connection_recycle_time = 3600 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:02 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] database.connection_trace = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] database.db_inc_retry_interval = True {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] database.db_max_retries = 20 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] database.db_max_retry_interval = 10 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] database.db_retry_interval = 1 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] database.max_overflow = 50 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] database.max_pool_size = 5 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] database.max_retries = 10 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack quobyte-client[86276]: Reading configuration file: /etc/quobyte/client.cfg Sep 01 08:12:03 devstack quobyte-client[86276]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] database.mysql_wsrep_sync_wait = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] database.pool_timeout = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] database.retry_interval = 10 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] database.slave_connection = **** {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] database.sqlite_synchronous = True {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] database.synchronous_reader = True {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] database.use_db_reconnect = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_tracing.insecure = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86275]: DEBUG oslo_concurrency.processutils [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] CMD "mount.quobyte" returned: 1 in 0.124s {{(pid=86275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:12:03 devstack cinder-volume[86275]: DEBUG oslo_concurrency.lockutils [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86275) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:12:03 devstack cinder-volume[86275]: DEBUG oslo_concurrency.lockutils [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86275) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:12:03 devstack cinder-volume[86275]: DEBUG cinder.volume.drivers.quobyte [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86275) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] profiler.connection_string = messaging:// {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] profiler.enabled = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] profiler.es_doc_type = notification {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] profiler.es_scroll_size = 10000 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] profiler.es_scroll_time = 2m {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] profiler.filter_error_trace = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86275]: INFO cinder.volume.drivers.quobyte [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 ... Sep 01 08:12:03 devstack cinder-volume[86275]: DEBUG oslo_concurrency.processutils [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 -c /etc/quobyte/client-cinder.cfg {{(pid=86275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] profiler.hmac_keys = **** {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] profiler.sentinel_service_name = mymaster {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] profiler.socket_timeout = 0.1 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] profiler.trace_requests = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] profiler.trace_sqlalchemy = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] profiler_jaeger.process_tags = {} {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] profiler_jaeger.service_name_prefix = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] profiler_otlp.service_name_prefix = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_policy.enforce_new_defaults = True {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_policy.policy_default_rule = default {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_policy.policy_file = policy.yaml {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] privsep_osbrick.group = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] privsep_osbrick.helper_command = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] privsep_osbrick.user = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cinder_sys_admin.group = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cinder_sys_admin.helper_command = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] cinder_sys_admin.user = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] service_user.auth_section = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] service_user.auth_type = password {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] service_user.cafile = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] service_user.certfile = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] service_user.collect_timing = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] service_user.insecure = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] service_user.keyfile = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] service_user.send_service_user_token = True {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] service_user.split_loggers = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] service_user.timeout = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] glance.auth_section = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] glance.auth_type = password {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] glance.certfile = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] glance.collect_timing = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] glance.insecure = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] glance.keyfile = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] glance.region_name = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] glance.split_loggers = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] glance.timeout = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.backend_availability_zone = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.chap_password = **** {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.chap_username = {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.disk_geometry = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.driver_client_cert = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.driver_client_cert_key = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.driver_data_namespace = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.driver_use_ssl = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.extra_capabilities = {} {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.filter_function = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.goodness_function = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.iscsi_target_flags = {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.iscsi_write_cache = on {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.iser_helper = tgtadm {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.iser_ip_address = 192.168.122.100 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.iser_port = 3260 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.nas_host = {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.nas_login = admin {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.nas_mount_options = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.nas_password = **** {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.nas_private_key = {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.nas_share_path = {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack sudo[86277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 -c /etc/quobyte/client-cinder.cfg Sep 01 08:12:03 devstack sudo[86277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.num_shell_tries = 3 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.quobyte_volume_url = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.replication_device = **** {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.report_discard_supported = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.reserved_percentage = 0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.target_helper = tgtadm {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.target_ip_address = 192.168.122.100 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.target_port = 3260 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.target_protocol = iscsi {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.trace_flags = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.unique_fqdn_network = True {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.use_chap_auth = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.volume_backend_name = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.volume_clear = zero {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.volume_clear_ionice = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.volume_clear_size = 0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_reports.file_event_handler = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_reports.log_dir = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.backend_availability_zone = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.backend_host = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.chap_password = **** {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.chap_username = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.chiscsi_conf = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.disk_geometry = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.driver_client_cert = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.driver_data_namespace = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.driver_use_ssl = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.extra_capabilities = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.filter_function = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.goodness_function = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.iser_helper = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.iser_ip_address = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.iser_port = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.iser_target_prefix = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.nas_host = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.nas_login = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.nas_mount_options = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.nas_password = **** {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.nas_private_key = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.nas_share_path = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.nas_ssh_port = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.num_shell_tries = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.nvmet_port_id = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.replication_device = **** {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.report_discard_supported = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.reserved_percentage = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.scst_target_driver = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.storage_protocol = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.target_helper = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.target_ip_address = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.target_port = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.target_prefix = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.target_protocol = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.trace_flags = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.use_chap_auth = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.volume_clear = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.volume_clear_size = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] QuobyteHD.volumes_dir = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.ssl = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_notifications.driver = [] {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_notifications.retry = -1 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] key_manager.fixed_key = **** {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] barbican.barbican_api_version = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] barbican.barbican_endpoint = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] barbican.barbican_endpoint_type = public {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] barbican.barbican_region_name = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] barbican.cafile = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] barbican.certfile = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] barbican.collect_timing = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] barbican.insecure = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] barbican.keyfile = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] barbican.number_of_retries = 60 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] barbican.retry_delay = 1 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] barbican.send_service_user_token = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] barbican.split_loggers = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] barbican.timeout = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] barbican.verify_ssl = True {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] barbican.verify_ssl_path = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] barbican_service_user.auth_section = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] barbican_service_user.auth_type = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] barbican_service_user.cafile = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] barbican_service_user.certfile = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] barbican_service_user.collect_timing = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] barbican_service_user.insecure = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] barbican_service_user.keyfile = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] barbican_service_user.split_loggers = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] barbican_service_user.timeout = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] vault.approle_role_id = **** {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] vault.approle_secret_id = **** {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] vault.auth_method = approle {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] vault.auth_path = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] vault.kv_mountpoint = secret {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] vault.kv_path = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] vault.kv_version = 2 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] vault.namespace = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] vault.root_token_id = **** {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] vault.ssl_ca_crt_file = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] vault.timeout = 60.0 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] vault.token_file = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] vault.token_role = None {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] vault.use_ssl = False {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:03 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] ******************************************************************************** {{(pid=86061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 08:12:03 devstack sudo[86277]: pam_unix(sudo:session): session closed for user root Sep 01 08:12:03 devstack cinder-volume[86275]: DEBUG oslo_concurrency.processutils [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.465s {{(pid=86275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:12:03 devstack cinder-volume[86275]: INFO cinder.volume.drivers.quobyte [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 succeeded Sep 01 08:12:03 devstack cinder-volume[86275]: DEBUG cinder.volume.drivers.quobyte [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86275) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:12:03 devstack cinder-volume[86275]: DEBUG oslo_concurrency.lockutils [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.485s {{(pid=86275) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:12:03 devstack cinder-volume[86275]: DEBUG oslo_concurrency.processutils [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:12:03 devstack sudo[86350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:12:03 devstack sudo[86350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:12:03 devstack sudo[86350]: pam_unix(sudo:session): session closed for user root Sep 01 08:12:03 devstack cinder-volume[86275]: DEBUG oslo_concurrency.processutils [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.238s {{(pid=86275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:12:03 devstack cinder-volume[86275]: INFO cinder.volume.driver [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Driver hasn't implemented _init_vendor_properties() Sep 01 08:12:03 devstack cinder-volume[86275]: DEBUG cinder.volume.driver [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.0671081542969, 'free_capacity_gb': 1774.0671081542969, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86275) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 08:12:03 devstack cinder-volume[86275]: DEBUG oslo_db.sqlalchemy.engines [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86275) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 08:12:03 devstack cinder-volume[86275]: DEBUG dbcounter [-] [86275] Writer thread running {{(pid=86275) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 08:12:03 devstack cinder-volume[86275]: DEBUG cinder.db.api [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Building query based on filter {{(pid=86275) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 08:12:03 devstack cinder-volume[86275]: DEBUG cinder.image.image_utils [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86275) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 08:12:03 devstack cinder-volume[86275]: INFO cinder.keymgr.migration [None req-098a102d-0cc3-4dbe-87b0-5a9015697813 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 08:12:03 devstack cinder-volume[86275]: DEBUG oslo_concurrency.lockutils [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86275) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:12:03 devstack cinder-volume[86275]: DEBUG oslo_concurrency.lockutils [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86275) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:12:03 devstack cinder-volume[86275]: DEBUG cinder.volume.drivers.quobyte [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86275) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:12:03 devstack cinder-volume[86275]: DEBUG cinder.volume.drivers.quobyte [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86275) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:12:03 devstack cinder-volume[86275]: DEBUG oslo_concurrency.lockutils [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86275) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:12:03 devstack cinder-volume[86275]: DEBUG oslo_concurrency.processutils [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:12:03 devstack sudo[86353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:12:03 devstack sudo[86353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:12:04 devstack sudo[86353]: pam_unix(sudo:session): session closed for user root Sep 01 08:12:04 devstack cinder-volume[86275]: DEBUG oslo_concurrency.processutils [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.231s {{(pid=86275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:12:04 devstack cinder-volume[86275]: DEBUG cinder.manager [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Notifying Schedulers of capabilities ... {{(pid=86275) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:12:04 devstack cinder-volume[86275]: INFO cinder.volume.manager [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Driver initialization completed successfully. Sep 01 08:12:04 devstack cinder-volume[86275]: INFO cinder.manager [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Initiating service 3 cleanup Sep 01 08:12:04 devstack cinder-volume[86275]: INFO cinder.manager [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Service 3 cleanup completed. Sep 01 08:12:04 devstack cinder-volume[86275]: DEBUG cinder.service [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Creating RPC server for service cinder-volume {{(pid=86275) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 08:12:04 devstack cinder-volume[86275]: DEBUG cinder.service [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86275) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 08:12:04 devstack cinder-volume[86275]: INFO cinder.volume.manager [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 01 08:12:04 devstack cinder-volume[86275]: DEBUG oslo_concurrency.lockutils [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86275) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:12:04 devstack cinder-volume[86275]: DEBUG oslo_concurrency.lockutils [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86275) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:12:04 devstack cinder-volume[86275]: DEBUG cinder.volume.drivers.quobyte [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86275) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:12:04 devstack cinder-volume[86275]: DEBUG cinder.volume.drivers.quobyte [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86275) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:12:04 devstack cinder-volume[86275]: DEBUG oslo_concurrency.lockutils [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86275) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:12:04 devstack cinder-volume[86275]: DEBUG oslo_concurrency.processutils [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:12:04 devstack sudo[86356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:12:04 devstack sudo[86356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:12:04 devstack sudo[86356]: pam_unix(sudo:session): session closed for user root Sep 01 08:12:04 devstack cinder-volume[86275]: DEBUG oslo_concurrency.processutils [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.255s {{(pid=86275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:12:04 devstack cinder-volume[86275]: INFO cinder.volume.manager [None req-218ebdcc-f4a1-4010-8a59-bc8ea4185ae2 None None] Driver post RPC initialization completed successfully. Sep 01 08:12:09 devstack cinder-volume[86275]: DEBUG oslo_concurrency.lockutils [None req-959559d4-e315-41c9-9dba-c0a1ec07d4ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86275) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:12:09 devstack cinder-volume[86275]: DEBUG oslo_concurrency.lockutils [None req-959559d4-e315-41c9-9dba-c0a1ec07d4ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86275) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:12:09 devstack cinder-volume[86275]: DEBUG cinder.volume.drivers.quobyte [None req-959559d4-e315-41c9-9dba-c0a1ec07d4ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86275) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:12:09 devstack cinder-volume[86275]: DEBUG cinder.volume.drivers.quobyte [None req-959559d4-e315-41c9-9dba-c0a1ec07d4ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86275) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:12:09 devstack cinder-volume[86275]: DEBUG oslo_concurrency.lockutils [None req-959559d4-e315-41c9-9dba-c0a1ec07d4ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86275) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:12:09 devstack cinder-volume[86275]: DEBUG oslo_concurrency.processutils [None req-959559d4-e315-41c9-9dba-c0a1ec07d4ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:12:09 devstack sudo[86481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:12:09 devstack sudo[86481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:12:09 devstack sudo[86481]: pam_unix(sudo:session): session closed for user root Sep 01 08:12:09 devstack cinder-volume[86275]: DEBUG oslo_concurrency.processutils [None req-959559d4-e315-41c9-9dba-c0a1ec07d4ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.230s {{(pid=86275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:12:09 devstack cinder-volume[86275]: DEBUG cinder.manager [None req-959559d4-e315-41c9-9dba-c0a1ec07d4ab None None] Notifying Schedulers of capabilities ... {{(pid=86275) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:12:12 devstack cinder-volume[86061]: INFO oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] Caught SIGTERM, stopping children Sep 01 08:12:12 devstack cinder-volume[86061]: DEBUG oslo_concurrency.lockutils [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] Acquiring lock "singleton_lock" {{(pid=86061) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 08:12:12 devstack cinder-volume[86061]: DEBUG oslo_concurrency.lockutils [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] Acquired lock "singleton_lock" {{(pid=86061) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 08:12:12 devstack cinder-volume[86061]: DEBUG oslo_concurrency.lockutils [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] Releasing lock "singleton_lock" {{(pid=86061) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 08:12:12 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] Stop services. {{(pid=86061) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 01 08:12:12 devstack cinder-volume[86061]: DEBUG oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] Killing children. {{(pid=86061) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 01 08:12:12 devstack cinder-volume[86061]: INFO oslo_service.backend._eventlet.service [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] Waiting on 1 children to exit Sep 01 08:12:14 devstack cinder-volume[86275]: DEBUG dbcounter [-] [86275] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86275) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:12:14 devstack cinder-volume[86275]: DEBUG dbcounter [-] [86275] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=86275) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:12:17 devstack cinder-volume[86275]: DEBUG oslo_concurrency.lockutils [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] Acquiring lock "singleton_lock" {{(pid=86275) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 08:12:17 devstack cinder-volume[86275]: DEBUG oslo_concurrency.lockutils [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] Acquired lock "singleton_lock" {{(pid=86275) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 08:12:17 devstack cinder-volume[86275]: DEBUG oslo_concurrency.lockutils [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] Releasing lock "singleton_lock" {{(pid=86275) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 08:12:17 devstack cinder-volume[86275]: WARNING amqp [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 08:12:17 devstack cinder-volume[86275]: WARNING amqp [None req-387b3ef3-dcdf-496a-9792-ea2bc46b2694 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 08:12:18 devstack cinder-volume[86595]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 08:12:18 devstack cinder-volume[86595]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 08:12:18 devstack cinder-volume[86595]: we strongly recommend against using it for new projects. Sep 01 08:12:18 devstack cinder-volume[86595]: If you are already using Eventlet, we recommend migrating to a different Sep 01 08:12:18 devstack cinder-volume[86595]: framework. For more detail see Sep 01 08:12:18 devstack cinder-volume[86595]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 08:12:18 devstack cinder-volume[86595]: import eventlet # noqa Sep 01 08:12:20 devstack cinder-volume[86595]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86595) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 08:12:20 devstack cinder-volume[86595]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86595) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 08:12:20 devstack cinder-volume[86595]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86595) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 08:12:21 devstack cinder-volume[86595]: INFO dbcounter [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] Registered counter for database cinder Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_db.sqlalchemy.engines [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86595) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG dbcounter [-] [86595] Writer thread running {{(pid=86595) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 08:12:21 devstack cinder-volume[86595]: INFO cinder.rpc [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 08:12:21 devstack cinder-volume[86595]: INFO cinder.rpc [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_db.sqlalchemy.engines [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86595) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 08:12:21 devstack cinder-volume[86595]: INFO cinder.volume.manager [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] Determined volume DB was empty at startup. Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG cinder.volume.manager [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86595) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 08:12:21 devstack cinder-volume[86595]: WARNING stevedore.named [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 08:12:21 devstack cinder-volume[86595]: WARNING castellan.key_manager [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 08:12:21 devstack cinder-volume[86595]: WARNING cinder.keymgr.conf_key_mgr [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 08:12:21 devstack cinder-volume[86595]: INFO cinder.volume.manager [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_db.sqlalchemy.engines [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86595) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 08:12:21 devstack cinder-volume[86595]: INFO oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] Starting 1 workers Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] Started child 86893 {{(pid=86595) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] Full set of CONF: {{(pid=86595) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] ******************************************************************************** {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] Configuration options gathered from: {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] ================================================================================ {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] allow_availability_zone_fallback = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] allow_compression_on_image_upload = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] allowed_direct_url_schemes = [] {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] api_rate_limit = True {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] auth_strategy = keystone {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_availability_zone = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_host = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_name = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_stats_polling_interval = 60 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backup_api_class = cinder.backup.api.API {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backup_name_template = backup-%s {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backup_use_same_host = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backup_use_temp_snapshot = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] chap_password = **** {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] chap_username = {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cinder_internal_tenant_project_id = 802393b924fd42e69130f9bb435a6077 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86893]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cinder_internal_tenant_user_id = 4c5318204c3a450b957b42fdf0484c8a {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cluster = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] compression_format = gzip {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] compute_api_class = cinder.compute.nova.API {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] config_dir = [] {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] config_source = [] {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] control_exchange = openstack {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] debug = True {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] default_availability_zone = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] default_group_type = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] default_volume_type = QuobyteHD {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] disk_geometry = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] driver_client_cert = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] driver_client_cert_key = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] driver_data_namespace = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] driver_ssl_cert_path = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] driver_ssl_cert_verify = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] driver_use_ssl = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] enable_new_services = True {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] enable_unsupported_driver = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] enabled_backends = ['QuobyteHD'] {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] enforce_multipath_for_image_xfer = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] filter_function = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] glance_api_insecure = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] glance_api_servers = ['http://192.168.122.100/image'] {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] glance_api_ssl_compression = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] glance_ca_certificates_file = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] glance_catalog_info = image:glance:publicURL {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] glance_certfile = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] glance_keyfile = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] glance_num_retries = 3 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] glance_request_timeout = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] goodness_function = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] graceful_shutdown_timeout = 5 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] group_api_class = cinder.group.api.API {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] host = devstack {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] image_compress_on_upload = True {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] image_conversion_address_space_limit = 1 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] image_conversion_cpu_limit = 60 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] image_conversion_disable = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] image_upload_use_cinder_backend = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] image_upload_use_internal_tenant = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] image_volume_cache_enabled = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] image_volume_cache_max_count = 0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] image_volume_cache_max_size_gb = 0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] init_host_max_objects_retrieval = 0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] instance_format = [instance: %(uuid)s] {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] iscsi_target_flags = {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] iscsi_write_cache = on {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] iser_helper = tgtadm {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] iser_ip_address = 192.168.122.100 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] iser_port = 3260 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] log_color = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] log_config_append = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] log_dir = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] log_file = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] log_options = True {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] log_rotate_interval = 1 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] log_rotate_interval_type = days {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] log_rotation_type = none {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] max_age = 0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] max_logfile_count = 30 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] max_logfile_size_mb = 200 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] max_over_subscription_ratio = 20.0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] message_reap_interval = 86400 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] message_ttl = 2592000 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] migration_create_volume_timeout_secs = 300 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] monkey_patch = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] monkey_patch_modules = [] {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] my_ip = 192.168.122.100 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] no_snapshot_gb_quota = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] num_iser_scan_tries = 3 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] num_shell_tries = 3 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] num_volume_device_scan_tries = 3 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] nvmeof_conn_info_version = 1 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] nvmet_ns_id = 10 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] nvmet_port_id = 1 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] osapi_max_limit = 1000 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] osapi_volume_ext_list = [] {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] osapi_volume_listen_port = 8776 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] osapi_volume_use_ssl = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] osapi_volume_workers = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] per_volume_size_limit = -1 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] periodic_fuzzy_delay = 60 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] periodic_interval = 60 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] public_endpoint = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] publish_errors = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] quota_backup_gigabytes = 1000 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] quota_backups = 10 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] quota_gigabytes = 1000 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] quota_groups = 10 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] quota_snapshots = 10 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] quota_volumes = 10 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] rate_limit_burst = 0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] rate_limit_except_level = CRITICAL {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] rate_limit_interval = 0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] reinit_driver_count = 3 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] replication_device = **** {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] report_discard_supported = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] report_interval = 120 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] reservation_clean_interval = 86400 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] reservation_expire = 86400 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] reserved_image_namespaces = [] {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] reserved_percentage = 0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] rpc_response_timeout = 120 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] run_external_periodic_tasks = True {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] scst_target_driver = iscsi {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] scst_target_iqn_name = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] service_down_time = 720 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] shell_completion = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] snapshot_name_template = snapshot-%s {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] split_loggers = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] state_path = /opt/stack/data/cinder {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] storage_availability_zone = nova {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] storage_protocol = iSCSI {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] syslog_log_facility = LOG_USER {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] target_helper = lioadm {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] target_ip_address = 192.168.122.100 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] target_port = 3260 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] target_protocol = iscsi {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] target_secondary_ip_addresses = [] {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] trace_flags = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Starting volume driver QuobyteDriver (1.2.1) Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86893) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] transport_url = **** {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] until_refresh = 0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] use_chap_auth = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] use_default_quota_class = True {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] use_journal = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] use_json = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] use_multipath_for_image_xfer = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] use_stderr = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] use_syslog = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] verify_glance_signatures = enabled {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] volume_api_class = cinder.volume.api.API {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] volume_backend_name = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] volume_clear = zero {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] volume_clear_ionice = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] volume_clear_size = 0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] volume_copy_bps_limit = 0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] volume_dd_blocksize = 1M {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] volume_name_template = volume-%s {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] volume_service_inithost_offload = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] volume_usage_audit_period = month {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] zoning_mode = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_concurrency.disable_process_locking = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.auth_section = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.auth_type = password {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.auth_version = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.cache = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.certfile = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.include_service_catalog = True {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.insecure = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.interface = public {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.keyfile = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.memcache_password = **** {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.memcache_username = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.region_name = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.service_type = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.100/identity {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.backend = dogpile.cache.null {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.backend_argument = **** {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.backend_expiration_time = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.config_prefix = cache.oslo {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.debug_cache_backend = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.enable_retry_client = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.enable_socket_keepalive = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.enabled = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.expiration_time = 600 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.hashclient_retry_attempts = 2 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.memcache_dead_retry = 300 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.memcache_pool_maxsize = 10 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.memcache_sasl_enabled = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.password = **** {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.proxies = [] {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.redis_db = 0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.redis_server = localhost:6379 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.retry_attempts = 2 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.retry_delay = 0.0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.socket_keepalive_count = 1 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.socket_keepalive_idle = 1 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.socket_keepalive_interval = 1 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.socket_timeout = 1.0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.tls_allowed_ciphers = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.tls_cafile = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.tls_certfile = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.tls_enabled = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.tls_keyfile = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cache.username = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] coordination.backend_url = **** {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] database.asyncio_connection = **** {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] database.asyncio_slave_connection = **** {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] database.backend = sqlalchemy {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] database.connection = **** {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] database.connection_debug = 0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] database.connection_parameters = {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] database.connection_recycle_time = 3600 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] database.connection_trace = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] database.db_inc_retry_interval = True {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] database.db_max_retries = 20 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] database.db_max_retry_interval = 10 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] database.db_retry_interval = 1 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] database.max_overflow = 50 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] database.max_pool_size = 5 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] database.max_retries = 10 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] database.mysql_wsrep_sync_wait = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] database.pool_timeout = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] database.retry_interval = 10 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] database.slave_connection = **** {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] database.sqlite_synchronous = True {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] database.synchronous_reader = True {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] database.use_db_reconnect = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_tracing.insecure = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] profiler.connection_string = messaging:// {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] profiler.enabled = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] profiler.es_doc_type = notification {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] profiler.es_scroll_size = 10000 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] profiler.es_scroll_time = 2m {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] profiler.filter_error_trace = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] profiler.hmac_keys = **** {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] profiler.sentinel_service_name = mymaster {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] profiler.socket_timeout = 0.1 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] profiler.trace_requests = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] profiler.trace_sqlalchemy = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] profiler_jaeger.process_tags = {} {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] profiler_jaeger.service_name_prefix = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] profiler_otlp.service_name_prefix = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_policy.enforce_new_defaults = True {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_policy.policy_default_rule = default {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_policy.policy_file = policy.yaml {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86893) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.quobyte [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] privsep_osbrick.group = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.quobyte [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] privsep_osbrick.helper_command = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Running cmd (subprocess): mount.quobyte {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] privsep_osbrick.user = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cinder_sys_admin.group = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cinder_sys_admin.helper_command = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] cinder_sys_admin.user = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] service_user.auth_section = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] service_user.auth_type = password {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] service_user.cafile = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] service_user.certfile = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] service_user.collect_timing = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] service_user.insecure = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] service_user.keyfile = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] service_user.send_service_user_token = True {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] service_user.split_loggers = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] service_user.timeout = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] glance.auth_section = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] glance.auth_type = password {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] glance.certfile = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] glance.collect_timing = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] glance.insecure = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] glance.keyfile = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] glance.region_name = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] glance.split_loggers = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] glance.timeout = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.backend_availability_zone = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.chap_password = **** {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.chap_username = {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.disk_geometry = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.driver_client_cert = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.driver_client_cert_key = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.driver_data_namespace = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.driver_use_ssl = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.extra_capabilities = {} {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.filter_function = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.goodness_function = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.iscsi_target_flags = {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:21 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.iscsi_write_cache = on {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.iser_helper = tgtadm {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.iser_ip_address = 192.168.122.100 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.iser_port = 3260 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.nas_host = {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.nas_login = admin {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.nas_mount_options = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.nas_password = **** {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.nas_private_key = {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.nas_share_path = {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.num_shell_tries = 3 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.quobyte_volume_url = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.replication_device = **** {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.report_discard_supported = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.reserved_percentage = 0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.target_helper = tgtadm {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.target_ip_address = 192.168.122.100 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.target_port = 3260 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.target_protocol = iscsi {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.trace_flags = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.unique_fqdn_network = True {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.use_chap_auth = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.volume_backend_name = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.volume_clear = zero {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.volume_clear_ionice = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.volume_clear_size = 0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_reports.file_event_handler = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_reports.log_dir = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.backend_availability_zone = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.backend_host = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.chap_password = **** {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] CMD "mount.quobyte" returned: 1 in 0.051s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.chap_username = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.chiscsi_conf = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.disk_geometry = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.driver_client_cert = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.driver_data_namespace = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.driver_use_ssl = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.extra_capabilities = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.filter_function = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.goodness_function = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.iser_helper = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.iser_ip_address = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.iser_port = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.iser_target_prefix = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.nas_host = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.nas_login = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.nas_mount_options = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.nas_password = **** {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.nas_private_key = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.nas_share_path = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.nas_ssh_port = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.num_shell_tries = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.nvmet_port_id = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.replication_device = **** {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.report_discard_supported = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.reserved_percentage = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.scst_target_driver = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.storage_protocol = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.target_helper = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.target_ip_address = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.target_port = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.target_prefix = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.target_protocol = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.trace_flags = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.use_chap_auth = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.volume_clear = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.volume_clear_size = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] QuobyteHD.volumes_dir = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack sudo[86903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:12:22 devstack sudo[86903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.ssl = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_notifications.driver = [] {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_notifications.retry = -1 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] key_manager.fixed_key = **** {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] barbican.barbican_api_version = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] barbican.barbican_endpoint = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] barbican.barbican_endpoint_type = public {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] barbican.barbican_region_name = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] barbican.cafile = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] barbican.certfile = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] barbican.collect_timing = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] barbican.insecure = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] barbican.keyfile = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] barbican.number_of_retries = 60 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] barbican.retry_delay = 1 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] barbican.send_service_user_token = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] barbican.split_loggers = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] barbican.timeout = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] barbican.verify_ssl = True {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] barbican.verify_ssl_path = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] barbican_service_user.auth_section = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] barbican_service_user.auth_type = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] barbican_service_user.cafile = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] barbican_service_user.certfile = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] barbican_service_user.collect_timing = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] barbican_service_user.insecure = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] barbican_service_user.keyfile = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] barbican_service_user.split_loggers = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] barbican_service_user.timeout = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] vault.approle_role_id = **** {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] vault.approle_secret_id = **** {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] vault.auth_method = approle {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] vault.auth_path = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] vault.kv_mountpoint = secret {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] vault.kv_path = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] vault.kv_version = 2 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] vault.namespace = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] vault.root_token_id = **** {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] vault.ssl_ca_crt_file = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] vault.timeout = 60.0 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] vault.token_file = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] vault.token_role = None {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] vault.use_ssl = False {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 08:12:22 devstack cinder-volume[86595]: DEBUG oslo_service.backend._eventlet.service [None req-60aff3ca-f919-480b-bf7a-7598fd0b97e7 None None] ******************************************************************************** {{(pid=86595) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 08:12:22 devstack sudo[86903]: pam_unix(sudo:session): session closed for user root Sep 01 08:12:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.248s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:12:22 devstack cinder-volume[86893]: INFO cinder.volume.driver [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Driver hasn't implemented _init_vendor_properties() Sep 01 08:12:22 devstack cinder-volume[86893]: DEBUG cinder.volume.driver [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.0671081542969, 'free_capacity_gb': 1774.0671081542969, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86893) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 08:12:22 devstack cinder-volume[86893]: DEBUG oslo_db.sqlalchemy.engines [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86893) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 08:12:22 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writer thread running {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 08:12:22 devstack cinder-volume[86893]: DEBUG cinder.db.api [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Building query based on filter {{(pid=86893) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 08:12:22 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86893) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 08:12:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:12:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:12:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:12:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:12:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:12:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:12:22 devstack cinder-volume[86893]: INFO cinder.keymgr.migration [None req-2cb05e49-edec-4eba-8e57-46894d90bacd None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 08:12:22 devstack sudo[86915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:12:22 devstack sudo[86915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:12:22 devstack sudo[86915]: pam_unix(sudo:session): session closed for user root Sep 01 08:12:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.246s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:12:22 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:12:22 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Driver initialization completed successfully. Sep 01 08:12:22 devstack cinder-volume[86893]: INFO cinder.manager [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Initiating service 3 cleanup Sep 01 08:12:22 devstack cinder-volume[86893]: INFO cinder.manager [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Service 3 cleanup completed. Sep 01 08:12:22 devstack cinder-volume[86893]: DEBUG cinder.service [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Creating RPC server for service cinder-volume {{(pid=86893) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 08:12:22 devstack cinder-volume[86893]: DEBUG cinder.service [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86893) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 08:12:22 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 01 08:12:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:12:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:12:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:12:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:12:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:12:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:12:22 devstack sudo[86919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:12:22 devstack sudo[86919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:12:23 devstack sudo[86919]: pam_unix(sudo:session): session closed for user root Sep 01 08:12:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.237s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:12:23 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-3aaeb4cc-05b3-4da9-959c-25e67e3bf46b None None] Driver post RPC initialization completed successfully. Sep 01 08:12:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager._thread_info {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:12:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread count: 6 {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 08:12:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread info: [<_MainThread(MainThread, started 138934582050944)>, , , , , ] {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 08:12:31 devstack cinder-volume[86595]: DEBUG dbcounter [-] [86595] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86595) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:12:32 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=2 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:12:33 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:13:20 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:13:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] Flow 'volume_create_manager' (f0bbdbe3-9551-473a-a88f-6b544bebd20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:13:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ef8444-eea4-4ca1-b9b9-de0b1f6bff98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:13:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ef8444-eea4-4ca1-b9b9-de0b1f6bff98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-524136147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac5571a7-b050-462f-9c8a-d7aca220d088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f62c49f69704493e9924f083050e6128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:13:20Z,use_quota=True,user_id='574695eb01d04e728298a50d69484b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:13:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (742b8471-be89-40e0-863e-364c46106b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:13:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (742b8471-be89-40e0-863e-364c46106b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:13:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0566c3-67d2-4794-8b1a-ff31d584a2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:13:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0566c3-67d2-4794-8b1a-ff31d584a2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac5571a7-b050-462f-9c8a-d7aca220d088', 'volume_name': 'volume-ac5571a7-b050-462f-9c8a-d7aca220d088', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:13:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3136b7e6-3c09-4197-a37e-cea17b3dcf3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:13:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3136b7e6-3c09-4197-a37e-cea17b3dcf3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:13:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d4d3d87-3022-489c-a692-20c8fba237b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:13:20 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] Volume ac5571a7-b050-462f-9c8a-d7aca220d088: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac5571a7-b050-462f-9c8a-d7aca220d088', 'volume_size': 1} Sep 01 08:13:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:13:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:13:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-524136147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac5571a7-b050-462f-9c8a-d7aca220d088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f62c49f69704493e9924f083050e6128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:13:20Z,use_quota=True,user_id='574695eb01d04e728298a50d69484b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:13:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] Creating volume ac5571a7-b050-462f-9c8a-d7aca220d088 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:13:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:13:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:13:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:13:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:13:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:13:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:13:20 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:13:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ac5571a7-b050-462f-9c8a-d7aca220d088 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:13:20 devstack sudo[87261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ac5571a7-b050-462f-9c8a-d7aca220d088 1073741824 Sep 01 08:13:20 devstack sudo[87261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:13:21 devstack sudo[87261]: pam_unix(sudo:session): session closed for user root Sep 01 08:13:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ac5571a7-b050-462f-9c8a-d7aca220d088 1073741824" returned: 0 in 0.556s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:13:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ac5571a7-b050-462f-9c8a-d7aca220d088 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:13:21 devstack sudo[87580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ac5571a7-b050-462f-9c8a-d7aca220d088 Sep 01 08:13:21 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:13:21 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root Sep 01 08:13:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ac5571a7-b050-462f-9c8a-d7aca220d088" returned: 0 in 0.313s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:13:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:13:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:13:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d4d3d87-3022-489c-a692-20c8fba237b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac5571a7-b050-462f-9c8a-d7aca220d088', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:13:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2afceb91-2e8e-43c1-8675-449128b24ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:13:21 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] Volume volume-ac5571a7-b050-462f-9c8a-d7aca220d088 (ac5571a7-b050-462f-9c8a-d7aca220d088): created successfully Sep 01 08:13:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2afceb91-2e8e-43c1-8675-449128b24ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:13:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] Flow 'volume_create_manager' (f0bbdbe3-9551-473a-a88f-6b544bebd20f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:13:21 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-9ced5b67-fc0b-4f1a-ad2a-eae026269b55 tempest-TaggedAttachmentsTest-131774961 None] Created volume successfully. Sep 01 08:13:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:13:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:13:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:13:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:13:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:13:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:13:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:13:31 devstack sudo[87690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:13:31 devstack sudo[87690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:13:31 devstack sudo[87690]: pam_unix(sudo:session): session closed for user root Sep 01 08:13:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.298s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:13:31 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:13:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager._thread_info {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:13:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread count: 6 {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 08:13:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread info: [<_MainThread(MainThread, started 138934582050944)>, , , , , ] {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 08:13:31 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:13:31 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:13:49 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:13:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] Flow 'volume_create_manager' (3d60b323-e3cf-4270-9778-84694b23c538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:13:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd7e5ed-7e3e-48ac-8182-7b00d36840d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:13:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd7e5ed-7e3e-48ac-8182-7b00d36840d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1940017110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3820e32-ab5a-4a40-bdc2-a6f92298872d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ccfe93f83d5469295e43996854885d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:13:50Z,use_quota=True,user_id='f76aef5fd8d24fb483d7951f5b34a7fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:13:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe83e2b9-255f-4fde-a966-90619776d168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:13:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe83e2b9-255f-4fde-a966-90619776d168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:13:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (669d5330-77b3-4ea6-bbad-6ff6633dd2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:13:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (669d5330-77b3-4ea6-bbad-6ff6633dd2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3820e32-ab5a-4a40-bdc2-a6f92298872d', 'volume_name': 'volume-a3820e32-ab5a-4a40-bdc2-a6f92298872d', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:13:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d24f422e-9643-4411-9dfd-6a6f41affcbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:13:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d24f422e-9643-4411-9dfd-6a6f41affcbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:13:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e58cb0b-575c-4fa1-bb06-c0869edfa183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:13:50 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] Volume a3820e32-ab5a-4a40-bdc2-a6f92298872d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3820e32-ab5a-4a40-bdc2-a6f92298872d', 'volume_size': 1} Sep 01 08:13:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:13:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:13:50 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1940017110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3820e32-ab5a-4a40-bdc2-a6f92298872d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ccfe93f83d5469295e43996854885d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:13:50Z,use_quota=True,user_id='f76aef5fd8d24fb483d7951f5b34a7fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:13:50 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] Creating volume a3820e32-ab5a-4a40-bdc2-a6f92298872d {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:13:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:13:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:13:50 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:13:50 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:13:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:13:50 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:13:50 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:13:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3820e32-ab5a-4a40-bdc2-a6f92298872d 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:13:50 devstack sudo[88012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3820e32-ab5a-4a40-bdc2-a6f92298872d 1073741824 Sep 01 08:13:50 devstack sudo[88012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:13:51 devstack sudo[88012]: pam_unix(sudo:session): session closed for user root Sep 01 08:13:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3820e32-ab5a-4a40-bdc2-a6f92298872d 1073741824" returned: 0 in 1.194s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:13:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3820e32-ab5a-4a40-bdc2-a6f92298872d {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:13:51 devstack sudo[88051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3820e32-ab5a-4a40-bdc2-a6f92298872d Sep 01 08:13:51 devstack sudo[88051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:13:52 devstack sudo[88051]: pam_unix(sudo:session): session closed for user root Sep 01 08:13:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3820e32-ab5a-4a40-bdc2-a6f92298872d" returned: 0 in 0.898s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:13:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] <== create_volume: return (2237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:13:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.244s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:13:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e58cb0b-575c-4fa1-bb06-c0869edfa183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3820e32-ab5a-4a40-bdc2-a6f92298872d', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:13:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8d1860-99f8-4657-b644-97280abad37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:13:52 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] Volume volume-a3820e32-ab5a-4a40-bdc2-a6f92298872d (a3820e32-ab5a-4a40-bdc2-a6f92298872d): created successfully Sep 01 08:13:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8d1860-99f8-4657-b644-97280abad37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:13:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] Flow 'volume_create_manager' (3d60b323-e3cf-4270-9778-84694b23c538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:13:52 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-d3ca687a-ed98-4866-b38e-21cdc1b8c709 tempest-VolumesAdminNegativeTest-407406012 None] Created volume successfully. Sep 01 08:13:53 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2e6b764b-1885-4079-b3fa-e518c29a1140 tempest-VolumesAdminNegativeTest-407406012 None] Acquiring lock "cinder-a3820e32-ab5a-4a40-bdc2-a6f92298872d-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:13:53 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2e6b764b-1885-4079-b3fa-e518c29a1140 tempest-VolumesAdminNegativeTest-407406012 None] Lock "cinder-a3820e32-ab5a-4a40-bdc2-a6f92298872d-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:13:54 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2e6b764b-1885-4079-b3fa-e518c29a1140 tempest-VolumesAdminNegativeTest-407406012 None] Acquiring lock "cinder-quobyte-a3820e32-ab5a-4a40-bdc2-a6f92298872d" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:13:54 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2e6b764b-1885-4079-b3fa-e518c29a1140 tempest-VolumesAdminNegativeTest-407406012 None] Lock "cinder-quobyte-a3820e32-ab5a-4a40-bdc2-a6f92298872d" acquired by "delete_volume" :: waited 0.045s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:13:54 devstack cinder-volume[86893]: INFO oslo.privsep.daemon [None req-2e6b764b-1885-4079-b3fa-e518c29a1140 tempest-VolumesAdminNegativeTest-407406012 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp18s_npz5/privsep.sock'] Sep 01 08:13:54 devstack sudo[88105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp18s_npz5/privsep.sock Sep 01 08:13:54 devstack sudo[88105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:13:55 devstack cinder-volume[86893]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 01 08:13:55 devstack cinder-volume[86893]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 08:13:55 devstack cinder-volume[86893]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 01 08:13:55 devstack cinder-volume[86893]: WARNING oslo.privsep.daemon [-] privsep log: Sep 01 08:13:55 devstack cinder-volume[86893]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 01 08:13:55 devstack cinder-volume[86893]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 01 08:13:55 devstack cinder-volume[86893]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 08:13:55 devstack cinder-volume[86893]: WARNING oslo.privsep.daemon [-] privsep log: Sep 01 08:13:55 devstack cinder-volume[86893]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 01 08:13:56 devstack sudo[88105]: pam_unix(sudo:session): session closed for user root Sep 01 08:13:56 devstack cinder-volume[86893]: INFO oslo.privsep.daemon [None req-2e6b764b-1885-4079-b3fa-e518c29a1140 tempest-VolumesAdminNegativeTest-407406012 None] Spawned new privsep daemon via rootwrap Sep 01 08:13:56 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [None req-2e6b764b-1885-4079-b3fa-e518c29a1140 tempest-VolumesAdminNegativeTest-407406012 None] Accepted privsep connection to /tmp/tmp18s_npz5/privsep.sock {{(pid=86893) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 01 08:13:56 devstack cinder-volume[86893]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 01 08:13:56 devstack cinder-volume[86893]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 01 08:13:56 devstack cinder-volume[86893]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 01 08:13:56 devstack cinder-volume[86893]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88145 Sep 01 08:13:56 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[c807e69a-9a40-433c-8af0-781417eb26d6]: (2,) {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:13:56 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da464a3-d830-4426-ba4c-f417062e3a5c]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:13:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2e6b764b-1885-4079-b3fa-e518c29a1140 tempest-VolumesAdminNegativeTest-407406012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3820e32-ab5a-4a40-bdc2-a6f92298872d {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:13:56 devstack sudo[88167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3820e32-ab5a-4a40-bdc2-a6f92298872d Sep 01 08:13:56 devstack sudo[88167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:13:56 devstack sudo[88167]: pam_unix(sudo:session): session closed for user root Sep 01 08:13:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2e6b764b-1885-4079-b3fa-e518c29a1140 tempest-VolumesAdminNegativeTest-407406012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3820e32-ab5a-4a40-bdc2-a6f92298872d" returned: 0 in 0.862s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:13:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2e6b764b-1885-4079-b3fa-e518c29a1140 tempest-VolumesAdminNegativeTest-407406012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3820e32-ab5a-4a40-bdc2-a6f92298872d {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:13:57 devstack sudo[88177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3820e32-ab5a-4a40-bdc2-a6f92298872d Sep 01 08:13:57 devstack sudo[88177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:13:57 devstack sudo[88177]: pam_unix(sudo:session): session closed for user root Sep 01 08:13:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2e6b764b-1885-4079-b3fa-e518c29a1140 tempest-VolumesAdminNegativeTest-407406012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3820e32-ab5a-4a40-bdc2-a6f92298872d" returned: 0 in 0.608s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:13:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2e6b764b-1885-4079-b3fa-e518c29a1140 tempest-VolumesAdminNegativeTest-407406012 None] Lock "cinder-quobyte-a3820e32-ab5a-4a40-bdc2-a6f92298872d" released by "delete_volume" :: held 3.532s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:13:57 devstack cinder-volume[86893]: WARNING cinder.quota [None req-2e6b764b-1885-4079-b3fa-e518c29a1140 tempest-VolumesAdminNegativeTest-407406012 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:13:57 devstack cinder-volume[86893]: WARNING cinder.quota [None req-2e6b764b-1885-4079-b3fa-e518c29a1140 tempest-VolumesAdminNegativeTest-407406012 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:13:57 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-2e6b764b-1885-4079-b3fa-e518c29a1140 tempest-VolumesAdminNegativeTest-407406012 None] Created reservations ['354ad18c-73c1-4b83-a471-2472efb9da02', 'e9839b7d-f5f7-42d5-ac75-fd371ab78d43', '785cdf1d-bfa0-45e2-b39c-86229598e974', '0de1a901-481e-40e7-8bef-5aa248fbebc6'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:13:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2e6b764b-1885-4079-b3fa-e518c29a1140 tempest-VolumesAdminNegativeTest-407406012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:13:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2e6b764b-1885-4079-b3fa-e518c29a1140 tempest-VolumesAdminNegativeTest-407406012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:13:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2e6b764b-1885-4079-b3fa-e518c29a1140 tempest-VolumesAdminNegativeTest-407406012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:13:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2e6b764b-1885-4079-b3fa-e518c29a1140 tempest-VolumesAdminNegativeTest-407406012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:13:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2e6b764b-1885-4079-b3fa-e518c29a1140 tempest-VolumesAdminNegativeTest-407406012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:13:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2e6b764b-1885-4079-b3fa-e518c29a1140 tempest-VolumesAdminNegativeTest-407406012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:13:57 devstack sudo[88180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:13:57 devstack sudo[88180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:13:58 devstack sudo[88180]: pam_unix(sudo:session): session closed for user root Sep 01 08:13:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2e6b764b-1885-4079-b3fa-e518c29a1140 tempest-VolumesAdminNegativeTest-407406012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.395s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:13:58 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-2e6b764b-1885-4079-b3fa-e518c29a1140 tempest-VolumesAdminNegativeTest-407406012 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:13:58 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-2e6b764b-1885-4079-b3fa-e518c29a1140 tempest-VolumesAdminNegativeTest-407406012 None] Deleted volume successfully. Sep 01 08:13:58 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2e6b764b-1885-4079-b3fa-e518c29a1140 tempest-VolumesAdminNegativeTest-407406012 None] Lock "cinder-a3820e32-ab5a-4a40-bdc2-a6f92298872d-delete_volume" released by "delete_volume" :: held 4.435s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:13:58 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:13:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] Flow 'volume_create_manager' (9e8fdab1-2e63-4f28-8700-598cf2b8ef1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:13:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af8f78f-e715-4004-966b-b02ffa1010df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:13:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af8f78f-e715-4004-966b-b02ffa1010df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1815474883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b48636-5392-4185-b09f-c181f8c965b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb4ea013ec84a51baebc3b751116832',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:13:59Z,use_quota=True,user_id='223bfeb0708f4dfabb9ffe70604f554c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:13:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc9893fa-fd53-4e0d-82d5-2b14bf54b7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:13:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc9893fa-fd53-4e0d-82d5-2b14bf54b7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:13:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f9bdfe-ba6b-4315-9de0-bec2b91964f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:13:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f9bdfe-ba6b-4315-9de0-bec2b91964f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98b48636-5392-4185-b09f-c181f8c965b6', 'volume_name': 'volume-98b48636-5392-4185-b09f-c181f8c965b6', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:13:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52252754-b526-4af8-bfd4-178f1b645259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:13:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52252754-b526-4af8-bfd4-178f1b645259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:13:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1e10a4-1391-418f-a2a0-bb83aa0d62a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:13:59 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] Volume 98b48636-5392-4185-b09f-c181f8c965b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98b48636-5392-4185-b09f-c181f8c965b6', 'volume_size': 1} Sep 01 08:13:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:13:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:13:59 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1815474883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b48636-5392-4185-b09f-c181f8c965b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb4ea013ec84a51baebc3b751116832',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:13:59Z,use_quota=True,user_id='223bfeb0708f4dfabb9ffe70604f554c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:13:59 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] Creating volume 98b48636-5392-4185-b09f-c181f8c965b6 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:13:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:13:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:13:59 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:13:59 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:13:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:13:59 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:13:59 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:13:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98b48636-5392-4185-b09f-c181f8c965b6 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:13:59 devstack sudo[88184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98b48636-5392-4185-b09f-c181f8c965b6 1073741824 Sep 01 08:13:59 devstack sudo[88184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:14:00 devstack sudo[88184]: pam_unix(sudo:session): session closed for user root Sep 01 08:14:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98b48636-5392-4185-b09f-c181f8c965b6 1073741824" returned: 0 in 1.136s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:14:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98b48636-5392-4185-b09f-c181f8c965b6 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:14:00 devstack sudo[88210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98b48636-5392-4185-b09f-c181f8c965b6 Sep 01 08:14:00 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:14:00 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root Sep 01 08:14:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98b48636-5392-4185-b09f-c181f8c965b6" returned: 0 in 0.311s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:14:00 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:14:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:14:00 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1e10a4-1391-418f-a2a0-bb83aa0d62a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98b48636-5392-4185-b09f-c181f8c965b6', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:14:00 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da01f0a1-fbfc-47f4-9125-b1c2abf53b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:14:00 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] Volume volume-98b48636-5392-4185-b09f-c181f8c965b6 (98b48636-5392-4185-b09f-c181f8c965b6): created successfully Sep 01 08:14:00 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da01f0a1-fbfc-47f4-9125-b1c2abf53b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:14:00 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] Flow 'volume_create_manager' (9e8fdab1-2e63-4f28-8700-598cf2b8ef1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:14:00 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-e81f1b1b-a6f0-4106-a081-7a756b6c2787 tempest-ServerRescueNegativeTestJSON-1656681048 None] Created volume successfully. Sep 01 08:14:10 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=8,cinder:UPDATE=16,cinder:INSERT=4 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:14:10 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:UPDATE=12,cinder:SELECT=10,cinder:DELETE=3,cinder:INSERT=2 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:14:29 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-52815bac-90c6-4ffb-9bc8-82ed6938866f tempest-ServerRescueNegativeTestJSON-1656681048 None] Acquiring lock "cinder-98b48636-5392-4185-b09f-c181f8c965b6-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:14:29 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-52815bac-90c6-4ffb-9bc8-82ed6938866f tempest-ServerRescueNegativeTestJSON-1656681048 None] Lock "cinder-98b48636-5392-4185-b09f-c181f8c965b6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:14:29 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-52815bac-90c6-4ffb-9bc8-82ed6938866f tempest-ServerRescueNegativeTestJSON-1656681048 None] Acquiring lock "cinder-quobyte-98b48636-5392-4185-b09f-c181f8c965b6" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:14:29 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-52815bac-90c6-4ffb-9bc8-82ed6938866f tempest-ServerRescueNegativeTestJSON-1656681048 None] Lock "cinder-quobyte-98b48636-5392-4185-b09f-c181f8c965b6" acquired by "delete_volume" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:14:29 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bd6d0a-d59c-4bd3-adb5-4b8e324d7ea2]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:14:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-52815bac-90c6-4ffb-9bc8-82ed6938866f tempest-ServerRescueNegativeTestJSON-1656681048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98b48636-5392-4185-b09f-c181f8c965b6 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:14:29 devstack sudo[88426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98b48636-5392-4185-b09f-c181f8c965b6 Sep 01 08:14:29 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:14:30 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root Sep 01 08:14:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-52815bac-90c6-4ffb-9bc8-82ed6938866f tempest-ServerRescueNegativeTestJSON-1656681048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98b48636-5392-4185-b09f-c181f8c965b6" returned: 0 in 0.856s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:14:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-52815bac-90c6-4ffb-9bc8-82ed6938866f tempest-ServerRescueNegativeTestJSON-1656681048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98b48636-5392-4185-b09f-c181f8c965b6 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:14:30 devstack sudo[88447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98b48636-5392-4185-b09f-c181f8c965b6 Sep 01 08:14:30 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:14:30 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root Sep 01 08:14:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-52815bac-90c6-4ffb-9bc8-82ed6938866f tempest-ServerRescueNegativeTestJSON-1656681048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98b48636-5392-4185-b09f-c181f8c965b6" returned: 0 in 0.639s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:14:30 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-52815bac-90c6-4ffb-9bc8-82ed6938866f tempest-ServerRescueNegativeTestJSON-1656681048 None] Lock "cinder-quobyte-98b48636-5392-4185-b09f-c181f8c965b6" released by "delete_volume" :: held 1.576s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:14:30 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-52815bac-90c6-4ffb-9bc8-82ed6938866f tempest-ServerRescueNegativeTestJSON-1656681048 None] Created reservations ['8712a37f-c3a3-4d76-a230-275348005a27', '67a89eb2-eb6d-46cb-9134-3bb69b811887', 'cb7da827-7e2a-46fb-8bca-c12dde2c1e5c', '6bc8c3d0-c3af-4189-bafe-55b8717ae18f'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:14:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:14:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:14:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:14:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:14:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:14:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:14:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:14:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-52815bac-90c6-4ffb-9bc8-82ed6938866f tempest-ServerRescueNegativeTestJSON-1656681048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:14:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-52815bac-90c6-4ffb-9bc8-82ed6938866f tempest-ServerRescueNegativeTestJSON-1656681048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:14:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-52815bac-90c6-4ffb-9bc8-82ed6938866f tempest-ServerRescueNegativeTestJSON-1656681048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:14:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-52815bac-90c6-4ffb-9bc8-82ed6938866f tempest-ServerRescueNegativeTestJSON-1656681048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:14:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-52815bac-90c6-4ffb-9bc8-82ed6938866f tempest-ServerRescueNegativeTestJSON-1656681048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:14:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-52815bac-90c6-4ffb-9bc8-82ed6938866f tempest-ServerRescueNegativeTestJSON-1656681048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:14:31 devstack sudo[88474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:14:31 devstack sudo[88474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:14:31 devstack sudo[88479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:14:31 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:14:31 devstack sudo[88474]: pam_unix(sudo:session): session closed for user root Sep 01 08:14:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.451s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:14:31 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:14:31 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root Sep 01 08:14:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-52815bac-90c6-4ffb-9bc8-82ed6938866f tempest-ServerRescueNegativeTestJSON-1656681048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.756s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:14:31 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-52815bac-90c6-4ffb-9bc8-82ed6938866f tempest-ServerRescueNegativeTestJSON-1656681048 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:14:31 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-52815bac-90c6-4ffb-9bc8-82ed6938866f tempest-ServerRescueNegativeTestJSON-1656681048 None] Deleted volume successfully. Sep 01 08:14:31 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-52815bac-90c6-4ffb-9bc8-82ed6938866f tempest-ServerRescueNegativeTestJSON-1656681048 None] Lock "cinder-98b48636-5392-4185-b09f-c181f8c965b6-delete_volume" released by "delete_volume" :: held 2.879s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:14:37 devstack cinder-volume[86893]: WARNING py.warnings [req-1efd1c4c-f6ab-4848-bf2a-c0a1f7c11978 req-c6444135-7130-409f-a189-163dbeb6a4e6 tempest-TaggedAttachmentsTest-131774961 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 01 08:14:37 devstack cinder-volume[86893]: .first() Sep 01 08:14:37 devstack cinder-volume[86893]: Sep 01 08:14:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-1efd1c4c-f6ab-4848-bf2a-c0a1f7c11978 req-c6444135-7130-409f-a189-163dbeb6a4e6 tempest-TaggedAttachmentsTest-131774961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:14:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-1efd1c4c-f6ab-4848-bf2a-c0a1f7c11978 req-c6444135-7130-409f-a189-163dbeb6a4e6 tempest-TaggedAttachmentsTest-131774961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:14:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-1efd1c4c-f6ab-4848-bf2a-c0a1f7c11978 req-c6444135-7130-409f-a189-163dbeb6a4e6 tempest-TaggedAttachmentsTest-131774961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:14:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-1efd1c4c-f6ab-4848-bf2a-c0a1f7c11978 req-c6444135-7130-409f-a189-163dbeb6a4e6 tempest-TaggedAttachmentsTest-131774961 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049', 'name': 'volume-ac5571a7-b050-462f-9c8a-d7aca220d088', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c50b102c-024f-4d45-8b37-272041ee347d', 'enforce_multipath': True} {{(pid=86893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 08:14:37 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-1efd1c4c-f6ab-4848-bf2a-c0a1f7c11978 req-c6444135-7130-409f-a189-163dbeb6a4e6 tempest-TaggedAttachmentsTest-131774961 None] attachment_update completed successfully. Sep 01 08:14:41 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-322e6670-4b18-4f08-8372-7f3721288b0c req-65fc687e-8c26-4336-819b-637b7097cb12 tempest-TaggedAttachmentsTest-131774961 None] Terminate volume connection completed successfully. Sep 01 08:14:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-322e6670-4b18-4f08-8372-7f3721288b0c req-65fc687e-8c26-4336-819b-637b7097cb12 tempest-TaggedAttachmentsTest-131774961 None] Deleting attachment c50b102c-024f-4d45-8b37-272041ee347d. {{(pid=86893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 08:14:44 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:14:44 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] Flow 'volume_create_manager' (a6632609-5dd3-476a-a74b-1ace0a8d9684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:14:44 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f66cd4-9f15-45d9-8ef6-ab9dc7b01ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:14:44 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f66cd4-9f15-45d9-8ef6-ab9dc7b01ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-251089997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5a7956d-61eb-490a-8957-07e54d252f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5db1f098825c467799c69ceb35f14eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:14:45Z,use_quota=True,user_id='6b36662cb9a54666a813f4465e22f99c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:14:44 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (831f35d4-b7c1-434b-9a52-854e15d728c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:14:44 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (831f35d4-b7c1-434b-9a52-854e15d728c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:14:44 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (370af237-2fa6-4687-add9-b9936dec0216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:14:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (370af237-2fa6-4687-add9-b9936dec0216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5a7956d-61eb-490a-8957-07e54d252f9b', 'volume_name': 'volume-e5a7956d-61eb-490a-8957-07e54d252f9b', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:14:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (079300bf-d6f3-4571-b01d-d57b71b949e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:14:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (079300bf-d6f3-4571-b01d-d57b71b949e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:14:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fdca4d2-d4f9-4da6-8fba-b5ff5422e004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:14:45 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] Volume e5a7956d-61eb-490a-8957-07e54d252f9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5a7956d-61eb-490a-8957-07e54d252f9b', 'volume_size': 1} Sep 01 08:14:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:14:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:14:45 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-251089997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5a7956d-61eb-490a-8957-07e54d252f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5db1f098825c467799c69ceb35f14eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:14:45Z,use_quota=True,user_id='6b36662cb9a54666a813f4465e22f99c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:14:45 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] Creating volume e5a7956d-61eb-490a-8957-07e54d252f9b {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:14:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:14:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:14:45 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:14:45 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:14:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:14:45 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:14:45 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:14:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5a7956d-61eb-490a-8957-07e54d252f9b 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:14:45 devstack sudo[89099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5a7956d-61eb-490a-8957-07e54d252f9b 1073741824 Sep 01 08:14:45 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:14:45 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root Sep 01 08:14:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5a7956d-61eb-490a-8957-07e54d252f9b 1073741824" returned: 0 in 0.727s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:14:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5a7956d-61eb-490a-8957-07e54d252f9b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:14:45 devstack sudo[89105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5a7956d-61eb-490a-8957-07e54d252f9b Sep 01 08:14:45 devstack sudo[89105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:14:46 devstack sudo[89105]: pam_unix(sudo:session): session closed for user root Sep 01 08:14:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5a7956d-61eb-490a-8957-07e54d252f9b" returned: 0 in 0.414s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:14:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:14:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:14:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fdca4d2-d4f9-4da6-8fba-b5ff5422e004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5a7956d-61eb-490a-8957-07e54d252f9b', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:14:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e62ece4-aaf5-4402-b2a6-4835f574e24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:14:46 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] Volume volume-e5a7956d-61eb-490a-8957-07e54d252f9b (e5a7956d-61eb-490a-8957-07e54d252f9b): created successfully Sep 01 08:14:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e62ece4-aaf5-4402-b2a6-4835f574e24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:14:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] Flow 'volume_create_manager' (a6632609-5dd3-476a-a74b-1ace0a8d9684) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:14:46 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-d0f422e3-6c83-43c9-bdcb-3f53f339964d tempest-DeleteServersTestJSON-323873034 None] Created volume successfully. Sep 01 08:14:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-12223ef0-b847-4775-9ea9-565db146a026 req-cdc94248-739f-43a3-a320-f2051ab773f3 tempest-DeleteServersTestJSON-323873034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:14:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-12223ef0-b847-4775-9ea9-565db146a026 req-cdc94248-739f-43a3-a320-f2051ab773f3 tempest-DeleteServersTestJSON-323873034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:14:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-12223ef0-b847-4775-9ea9-565db146a026 req-cdc94248-739f-43a3-a320-f2051ab773f3 tempest-DeleteServersTestJSON-323873034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:14:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-12223ef0-b847-4775-9ea9-565db146a026 req-cdc94248-739f-43a3-a320-f2051ab773f3 tempest-DeleteServersTestJSON-323873034 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049', 'name': 'volume-e5a7956d-61eb-490a-8957-07e54d252f9b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20796911-0cd8-4778-bcdc-f7590b723096', 'enforce_multipath': True} {{(pid=86893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 08:14:48 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-12223ef0-b847-4775-9ea9-565db146a026 req-cdc94248-739f-43a3-a320-f2051ab773f3 tempest-DeleteServersTestJSON-323873034 None] attachment_update completed successfully. Sep 01 08:14:56 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-03243eaa-0dc5-4cef-bcb3-ecf400f123a5 req-ceb3e568-5220-4c84-a9af-59618f65d706 tempest-DeleteServersTestJSON-323873034 None] Terminate volume connection completed successfully. Sep 01 08:14:56 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-03243eaa-0dc5-4cef-bcb3-ecf400f123a5 req-ceb3e568-5220-4c84-a9af-59618f65d706 tempest-DeleteServersTestJSON-323873034 None] Deleting attachment 20796911-0cd8-4778-bcdc-f7590b723096. {{(pid=86893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 08:14:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-39b9c787-fbfe-4b23-9990-c5e7c393b3be tempest-DeleteServersTestJSON-323873034 None] Acquiring lock "cinder-e5a7956d-61eb-490a-8957-07e54d252f9b-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:14:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-39b9c787-fbfe-4b23-9990-c5e7c393b3be tempest-DeleteServersTestJSON-323873034 None] Lock "cinder-e5a7956d-61eb-490a-8957-07e54d252f9b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:14:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-39b9c787-fbfe-4b23-9990-c5e7c393b3be tempest-DeleteServersTestJSON-323873034 None] Acquiring lock "cinder-quobyte-e5a7956d-61eb-490a-8957-07e54d252f9b" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:14:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-39b9c787-fbfe-4b23-9990-c5e7c393b3be tempest-DeleteServersTestJSON-323873034 None] Lock "cinder-quobyte-e5a7956d-61eb-490a-8957-07e54d252f9b" acquired by "delete_volume" :: waited 0.029s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:14:57 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b163b30f-984f-4f68-9ad1-be6413fe3879]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:14:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-39b9c787-fbfe-4b23-9990-c5e7c393b3be tempest-DeleteServersTestJSON-323873034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5a7956d-61eb-490a-8957-07e54d252f9b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:14:57 devstack sudo[89621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5a7956d-61eb-490a-8957-07e54d252f9b Sep 01 08:14:57 devstack sudo[89621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:14:58 devstack sudo[89621]: pam_unix(sudo:session): session closed for user root Sep 01 08:14:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-39b9c787-fbfe-4b23-9990-c5e7c393b3be tempest-DeleteServersTestJSON-323873034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5a7956d-61eb-490a-8957-07e54d252f9b" returned: 0 in 0.434s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:14:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-39b9c787-fbfe-4b23-9990-c5e7c393b3be tempest-DeleteServersTestJSON-323873034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5a7956d-61eb-490a-8957-07e54d252f9b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:14:58 devstack sudo[89629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5a7956d-61eb-490a-8957-07e54d252f9b Sep 01 08:14:58 devstack sudo[89629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:14:58 devstack sudo[89629]: pam_unix(sudo:session): session closed for user root Sep 01 08:14:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-39b9c787-fbfe-4b23-9990-c5e7c393b3be tempest-DeleteServersTestJSON-323873034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5a7956d-61eb-490a-8957-07e54d252f9b" returned: 0 in 0.271s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:14:58 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-39b9c787-fbfe-4b23-9990-c5e7c393b3be tempest-DeleteServersTestJSON-323873034 None] Lock "cinder-quobyte-e5a7956d-61eb-490a-8957-07e54d252f9b" released by "delete_volume" :: held 0.764s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:14:58 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-39b9c787-fbfe-4b23-9990-c5e7c393b3be tempest-DeleteServersTestJSON-323873034 None] Created reservations ['8d6138ea-a57e-4dcf-a753-1e10b77cf229', '1445a4ac-1dc2-446a-90ad-75473a8b4a6a', '60761808-3c05-4e8f-b147-85cc5bc94df0', '92c7e2d8-023d-4bab-ad3d-0961759a6915'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:14:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-39b9c787-fbfe-4b23-9990-c5e7c393b3be tempest-DeleteServersTestJSON-323873034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:14:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-39b9c787-fbfe-4b23-9990-c5e7c393b3be tempest-DeleteServersTestJSON-323873034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:14:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-39b9c787-fbfe-4b23-9990-c5e7c393b3be tempest-DeleteServersTestJSON-323873034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:14:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-39b9c787-fbfe-4b23-9990-c5e7c393b3be tempest-DeleteServersTestJSON-323873034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:14:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-39b9c787-fbfe-4b23-9990-c5e7c393b3be tempest-DeleteServersTestJSON-323873034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:14:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-39b9c787-fbfe-4b23-9990-c5e7c393b3be tempest-DeleteServersTestJSON-323873034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:14:58 devstack sudo[89632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:14:58 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:14:58 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root Sep 01 08:14:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-39b9c787-fbfe-4b23-9990-c5e7c393b3be tempest-DeleteServersTestJSON-323873034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.263s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:14:58 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-39b9c787-fbfe-4b23-9990-c5e7c393b3be tempest-DeleteServersTestJSON-323873034 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:14:58 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-39b9c787-fbfe-4b23-9990-c5e7c393b3be tempest-DeleteServersTestJSON-323873034 None] Deleted volume successfully. Sep 01 08:14:58 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-39b9c787-fbfe-4b23-9990-c5e7c393b3be tempest-DeleteServersTestJSON-323873034 None] Lock "cinder-e5a7956d-61eb-490a-8957-07e54d252f9b-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:15:02 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-91fe0818-3f67-419d-a892-5adc8ecd3fd6 tempest-TaggedAttachmentsTest-131774961 None] Acquiring lock "cinder-ac5571a7-b050-462f-9c8a-d7aca220d088-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:15:02 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-91fe0818-3f67-419d-a892-5adc8ecd3fd6 tempest-TaggedAttachmentsTest-131774961 None] Lock "cinder-ac5571a7-b050-462f-9c8a-d7aca220d088-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:15:02 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-91fe0818-3f67-419d-a892-5adc8ecd3fd6 tempest-TaggedAttachmentsTest-131774961 None] Acquiring lock "cinder-quobyte-ac5571a7-b050-462f-9c8a-d7aca220d088" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:15:02 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-91fe0818-3f67-419d-a892-5adc8ecd3fd6 tempest-TaggedAttachmentsTest-131774961 None] Lock "cinder-quobyte-ac5571a7-b050-462f-9c8a-d7aca220d088" acquired by "delete_volume" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:15:02 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4e6358-5c30-42fb-8e5f-8b61f08345c5]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:15:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-91fe0818-3f67-419d-a892-5adc8ecd3fd6 tempest-TaggedAttachmentsTest-131774961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ac5571a7-b050-462f-9c8a-d7aca220d088 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:03 devstack sudo[89640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ac5571a7-b050-462f-9c8a-d7aca220d088 Sep 01 08:15:03 devstack sudo[89640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:03 devstack sudo[89640]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-91fe0818-3f67-419d-a892-5adc8ecd3fd6 tempest-TaggedAttachmentsTest-131774961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ac5571a7-b050-462f-9c8a-d7aca220d088" returned: 0 in 0.396s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-91fe0818-3f67-419d-a892-5adc8ecd3fd6 tempest-TaggedAttachmentsTest-131774961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ac5571a7-b050-462f-9c8a-d7aca220d088 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:03 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ac5571a7-b050-462f-9c8a-d7aca220d088 Sep 01 08:15:03 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:03 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-91fe0818-3f67-419d-a892-5adc8ecd3fd6 tempest-TaggedAttachmentsTest-131774961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ac5571a7-b050-462f-9c8a-d7aca220d088" returned: 0 in 0.348s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:03 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-91fe0818-3f67-419d-a892-5adc8ecd3fd6 tempest-TaggedAttachmentsTest-131774961 None] Lock "cinder-quobyte-ac5571a7-b050-462f-9c8a-d7aca220d088" released by "delete_volume" :: held 0.804s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:15:03 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-91fe0818-3f67-419d-a892-5adc8ecd3fd6 tempest-TaggedAttachmentsTest-131774961 None] Created reservations ['6b260141-2ecd-4ae8-9fc3-f0499690cd7e', '1c65cac9-6f46-4515-ae16-a7f0f37c0be8', 'a2e7ad46-a55d-447a-816e-6b1c1006f125', '97acb520-65ad-4763-8290-442edf92516f'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:15:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-91fe0818-3f67-419d-a892-5adc8ecd3fd6 tempest-TaggedAttachmentsTest-131774961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:15:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-91fe0818-3f67-419d-a892-5adc8ecd3fd6 tempest-TaggedAttachmentsTest-131774961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:15:03 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-91fe0818-3f67-419d-a892-5adc8ecd3fd6 tempest-TaggedAttachmentsTest-131774961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:15:03 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-91fe0818-3f67-419d-a892-5adc8ecd3fd6 tempest-TaggedAttachmentsTest-131774961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:15:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-91fe0818-3f67-419d-a892-5adc8ecd3fd6 tempest-TaggedAttachmentsTest-131774961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:15:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-91fe0818-3f67-419d-a892-5adc8ecd3fd6 tempest-TaggedAttachmentsTest-131774961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:03 devstack sudo[89649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:15:03 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:04 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-91fe0818-3f67-419d-a892-5adc8ecd3fd6 tempest-TaggedAttachmentsTest-131774961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.280s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:04 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-91fe0818-3f67-419d-a892-5adc8ecd3fd6 tempest-TaggedAttachmentsTest-131774961 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:15:04 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-91fe0818-3f67-419d-a892-5adc8ecd3fd6 tempest-TaggedAttachmentsTest-131774961 None] Deleted volume successfully. Sep 01 08:15:04 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-91fe0818-3f67-419d-a892-5adc8ecd3fd6 tempest-TaggedAttachmentsTest-131774961 None] Lock "cinder-ac5571a7-b050-462f-9c8a-d7aca220d088-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:15:13 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:15:13 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] Flow 'volume_create_manager' (c69e2cab-af07-43bc-873a-074369522b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:15:13 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04b2f44-6fd2-4772-9b1c-abc00f34d432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:13 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=36,cinder:UPDATE=32,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:15:13 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04b2f44-6fd2-4772-9b1c-abc00f34d432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-293045766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=177c8a28-c14d-405e-b20c-b4fde11de991,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='525729abee1347b9bcd7487faaecf487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:15:14Z,use_quota=True,user_id='3c07687fc2c44490b9c9435a45ced793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:13 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (608ab11e-8aa2-4f2e-99d1-271381594a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:13 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (608ab11e-8aa2-4f2e-99d1-271381594a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:13 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d8d2b2c-e8f5-4f04-9b05-b27ca03ff306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:13 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d8d2b2c-e8f5-4f04-9b05-b27ca03ff306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '177c8a28-c14d-405e-b20c-b4fde11de991', 'volume_name': 'volume-177c8a28-c14d-405e-b20c-b4fde11de991', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:13 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f907daa2-4d1b-48c7-9e52-09f5a1ba4228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:13 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f907daa2-4d1b-48c7-9e52-09f5a1ba4228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:13 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f38f00f-9225-4b17-ae5a-2f76b929e13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:13 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] Volume 177c8a28-c14d-405e-b20c-b4fde11de991: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-177c8a28-c14d-405e-b20c-b4fde11de991', 'volume_size': 1} Sep 01 08:15:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:15:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:15:13 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-293045766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=177c8a28-c14d-405e-b20c-b4fde11de991,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='525729abee1347b9bcd7487faaecf487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:15:14Z,use_quota=True,user_id='3c07687fc2c44490b9c9435a45ced793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:15:13 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] Creating volume 177c8a28-c14d-405e-b20c-b4fde11de991 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:15:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:15:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:15:13 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:15:13 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:15:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:15:13 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:15:13 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:15:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-177c8a28-c14d-405e-b20c-b4fde11de991 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:13 devstack sudo[89709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-177c8a28-c14d-405e-b20c-b4fde11de991 1073741824 Sep 01 08:15:13 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:14 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-177c8a28-c14d-405e-b20c-b4fde11de991 1073741824" returned: 0 in 0.496s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-177c8a28-c14d-405e-b20c-b4fde11de991 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:14 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-177c8a28-c14d-405e-b20c-b4fde11de991 Sep 01 08:15:14 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:14 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-177c8a28-c14d-405e-b20c-b4fde11de991" returned: 0 in 0.274s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:14 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:15:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:15:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f38f00f-9225-4b17-ae5a-2f76b929e13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-177c8a28-c14d-405e-b20c-b4fde11de991', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12aeceac-e794-4351-8d81-96f0086b2028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:14 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] Volume volume-177c8a28-c14d-405e-b20c-b4fde11de991 (177c8a28-c14d-405e-b20c-b4fde11de991): created successfully Sep 01 08:15:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12aeceac-e794-4351-8d81-96f0086b2028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] Flow 'volume_create_manager' (c69e2cab-af07-43bc-873a-074369522b12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:15:14 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-db5885b0-097f-44b8-8d40-8154c6e15804 req-6e416224-e77a-46ff-bc5f-1ecb672c0b74 tempest-VolumesGetTestJSON-1186597474 None] Created volume successfully. Sep 01 08:15:15 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-df9759d5-25d7-437c-af15-f00bc1fb2bb5 req-54603bd1-b8d5-43fe-b2f2-48efebf185da tempest-VolumesGetTestJSON-1186597474 None] Acquiring lock "cinder-177c8a28-c14d-405e-b20c-b4fde11de991-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:15:15 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-df9759d5-25d7-437c-af15-f00bc1fb2bb5 req-54603bd1-b8d5-43fe-b2f2-48efebf185da tempest-VolumesGetTestJSON-1186597474 None] Lock "cinder-177c8a28-c14d-405e-b20c-b4fde11de991-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:15:16 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-df9759d5-25d7-437c-af15-f00bc1fb2bb5 req-54603bd1-b8d5-43fe-b2f2-48efebf185da tempest-VolumesGetTestJSON-1186597474 None] Acquiring lock "cinder-quobyte-177c8a28-c14d-405e-b20c-b4fde11de991" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:15:16 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-df9759d5-25d7-437c-af15-f00bc1fb2bb5 req-54603bd1-b8d5-43fe-b2f2-48efebf185da tempest-VolumesGetTestJSON-1186597474 None] Lock "cinder-quobyte-177c8a28-c14d-405e-b20c-b4fde11de991" acquired by "delete_volume" :: waited 0.038s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:15:16 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca784b53-f1d7-419c-8e3f-ef77506cc9d7]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:15:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-df9759d5-25d7-437c-af15-f00bc1fb2bb5 req-54603bd1-b8d5-43fe-b2f2-48efebf185da tempest-VolumesGetTestJSON-1186597474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-177c8a28-c14d-405e-b20c-b4fde11de991 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:16 devstack sudo[89724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-177c8a28-c14d-405e-b20c-b4fde11de991 Sep 01 08:15:16 devstack sudo[89724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:17 devstack sudo[89724]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-df9759d5-25d7-437c-af15-f00bc1fb2bb5 req-54603bd1-b8d5-43fe-b2f2-48efebf185da tempest-VolumesGetTestJSON-1186597474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-177c8a28-c14d-405e-b20c-b4fde11de991" returned: 0 in 0.932s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-df9759d5-25d7-437c-af15-f00bc1fb2bb5 req-54603bd1-b8d5-43fe-b2f2-48efebf185da tempest-VolumesGetTestJSON-1186597474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-177c8a28-c14d-405e-b20c-b4fde11de991 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:17 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-177c8a28-c14d-405e-b20c-b4fde11de991 Sep 01 08:15:17 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:17 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-df9759d5-25d7-437c-af15-f00bc1fb2bb5 req-54603bd1-b8d5-43fe-b2f2-48efebf185da tempest-VolumesGetTestJSON-1186597474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-177c8a28-c14d-405e-b20c-b4fde11de991" returned: 0 in 0.679s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:17 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-df9759d5-25d7-437c-af15-f00bc1fb2bb5 req-54603bd1-b8d5-43fe-b2f2-48efebf185da tempest-VolumesGetTestJSON-1186597474 None] Lock "cinder-quobyte-177c8a28-c14d-405e-b20c-b4fde11de991" released by "delete_volume" :: held 1.720s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:15:17 devstack cinder-volume[86893]: DEBUG cinder.quota [req-df9759d5-25d7-437c-af15-f00bc1fb2bb5 req-54603bd1-b8d5-43fe-b2f2-48efebf185da tempest-VolumesGetTestJSON-1186597474 None] Created reservations ['6da88702-ce77-45e3-b63c-e27ebb85e03f', '6b04af20-af1a-4b70-9f9e-416f27ea9d47', '54d0bb6e-2f2d-4398-8944-5f58d366a783', '5c399692-9460-42d9-86b4-c919c6608760'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:15:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-df9759d5-25d7-437c-af15-f00bc1fb2bb5 req-54603bd1-b8d5-43fe-b2f2-48efebf185da tempest-VolumesGetTestJSON-1186597474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:15:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-df9759d5-25d7-437c-af15-f00bc1fb2bb5 req-54603bd1-b8d5-43fe-b2f2-48efebf185da tempest-VolumesGetTestJSON-1186597474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:15:18 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [req-df9759d5-25d7-437c-af15-f00bc1fb2bb5 req-54603bd1-b8d5-43fe-b2f2-48efebf185da tempest-VolumesGetTestJSON-1186597474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:15:18 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [req-df9759d5-25d7-437c-af15-f00bc1fb2bb5 req-54603bd1-b8d5-43fe-b2f2-48efebf185da tempest-VolumesGetTestJSON-1186597474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:15:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-df9759d5-25d7-437c-af15-f00bc1fb2bb5 req-54603bd1-b8d5-43fe-b2f2-48efebf185da tempest-VolumesGetTestJSON-1186597474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:15:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-df9759d5-25d7-437c-af15-f00bc1fb2bb5 req-54603bd1-b8d5-43fe-b2f2-48efebf185da tempest-VolumesGetTestJSON-1186597474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:18 devstack sudo[89835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:15:18 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:19 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-df9759d5-25d7-437c-af15-f00bc1fb2bb5 req-54603bd1-b8d5-43fe-b2f2-48efebf185da tempest-VolumesGetTestJSON-1186597474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.825s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:19 devstack cinder-volume[86893]: DEBUG cinder.manager [req-df9759d5-25d7-437c-af15-f00bc1fb2bb5 req-54603bd1-b8d5-43fe-b2f2-48efebf185da tempest-VolumesGetTestJSON-1186597474 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:15:19 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-df9759d5-25d7-437c-af15-f00bc1fb2bb5 req-54603bd1-b8d5-43fe-b2f2-48efebf185da tempest-VolumesGetTestJSON-1186597474 None] Deleted volume successfully. Sep 01 08:15:19 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-df9759d5-25d7-437c-af15-f00bc1fb2bb5 req-54603bd1-b8d5-43fe-b2f2-48efebf185da tempest-VolumesGetTestJSON-1186597474 None] Lock "cinder-177c8a28-c14d-405e-b20c-b4fde11de991-delete_volume" released by "delete_volume" :: held 3.301s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:15:28 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=34,cinder:UPDATE=42,cinder:INSERT=9,cinder:DELETE=5 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:15:28 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:15:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] Flow 'volume_create_manager' (e4a5d1d0-0da0-4fe8-a905-378542175942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:15:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342265c5-8f99-4227-9485-9e9ba224bc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342265c5-8f99-4227-9485-9e9ba224bc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-306950191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17a05450-1fc4-467f-b1da-c970c5414e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36e1d71ce03d4dcea98868eac5d159a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:15:28Z,use_quota=True,user_id='915a083d91f64917a9030b8b39176174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8312bf-7a4c-4836-afc6-874f05d1cca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8312bf-7a4c-4836-afc6-874f05d1cca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (978592c2-d5ec-4191-b4d0-4474ad9f67c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (978592c2-d5ec-4191-b4d0-4474ad9f67c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17a05450-1fc4-467f-b1da-c970c5414e8a', 'volume_name': 'volume-17a05450-1fc4-467f-b1da-c970c5414e8a', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1627f8db-a112-459d-b9f0-d5fef1716490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1627f8db-a112-459d-b9f0-d5fef1716490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f60cc4b4-4594-44ce-99af-e225e27a1007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:28 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] Volume 17a05450-1fc4-467f-b1da-c970c5414e8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17a05450-1fc4-467f-b1da-c970c5414e8a', 'volume_size': 1} Sep 01 08:15:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:15:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:15:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-306950191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17a05450-1fc4-467f-b1da-c970c5414e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36e1d71ce03d4dcea98868eac5d159a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:15:28Z,use_quota=True,user_id='915a083d91f64917a9030b8b39176174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:15:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] Creating volume 17a05450-1fc4-467f-b1da-c970c5414e8a {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:15:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:15:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:15:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:15:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:15:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:15:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:15:28 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:15:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:28 devstack sudo[89896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a 1073741824 Sep 01 08:15:28 devstack sudo[89896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:29 devstack sudo[89896]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a 1073741824" returned: 0 in 0.932s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a298c896-667f-4e4f-ac97-e4510239c4fe tempest-BackendsCapabilitiesAdminTestsJSON-564455719 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.0671081542969, 'free_capacity_gb': 1774.0671081542969, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86893) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 08:15:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:29 devstack sudo[89917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a Sep 01 08:15:29 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2c3de755-ed10-47b6-9d7c-720b0494a0b0 tempest-BackendsCapabilitiesAdminTestsJSON-564455719 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.0671081542969, 'free_capacity_gb': 1774.0671081542969, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86893) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 08:15:30 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a" returned: 0 in 0.633s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:15:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:15:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f60cc4b4-4594-44ce-99af-e225e27a1007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17a05450-1fc4-467f-b1da-c970c5414e8a', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b3bfe4-d4f8-4d29-bef2-0f4b6a22b239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:30 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] Volume volume-17a05450-1fc4-467f-b1da-c970c5414e8a (17a05450-1fc4-467f-b1da-c970c5414e8a): created successfully Sep 01 08:15:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b3bfe4-d4f8-4d29-bef2-0f4b6a22b239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] Flow 'volume_create_manager' (e4a5d1d0-0da0-4fe8-a905-378542175942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:15:30 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-2b46f120-b47a-4009-becd-41e84a96f79e req-2227512c-fa86-4810-b26b-1377b6a252d2 tempest-VolumesSnapshotsTestJSON-648712039 None] Created volume successfully. Sep 01 08:15:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:15:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:15:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:15:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:15:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:15:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:15:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:31 devstack sudo[89920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:15:31 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:31 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.614s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:31 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:15:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager._thread_info {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:15:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread count: 8 {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 08:15:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread info: [<_MainThread(MainThread, started 138934582050944)>, , , , , , , ] {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 08:15:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-ed838cb7-3f98-4cd6-91ab-1523fb0101f9 req-925cc0e3-c2de-4c7f-8426-c4d73c34dcb8 tempest-VolumesSnapshotsTestJSON-648712039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:15:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-ed838cb7-3f98-4cd6-91ab-1523fb0101f9 req-925cc0e3-c2de-4c7f-8426-c4d73c34dcb8 tempest-VolumesSnapshotsTestJSON-648712039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:15:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [req-ed838cb7-3f98-4cd6-91ab-1523fb0101f9 req-925cc0e3-c2de-4c7f-8426-c4d73c34dcb8 tempest-VolumesSnapshotsTestJSON-648712039 None] Creating offline snapshot 1744b2e1-691e-41ec-8373-9e2ffb23ec85 of volume 17a05450-1fc4-467f-b1da-c970c5414e8a {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:15:31 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f86391f-cb28-414c-8132-110fcb358b5f]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:15:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-ed838cb7-3f98-4cd6-91ab-1523fb0101f9 req-925cc0e3-c2de-4c7f-8426-c4d73c34dcb8 tempest-VolumesSnapshotsTestJSON-648712039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:32 devstack sudo[89925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a Sep 01 08:15:32 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:32 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-ed838cb7-3f98-4cd6-91ab-1523fb0101f9 req-925cc0e3-c2de-4c7f-8426-c4d73c34dcb8 tempest-VolumesSnapshotsTestJSON-648712039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a" returned: 0 in 0.744s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-ed838cb7-3f98-4cd6-91ab-1523fb0101f9 req-925cc0e3-c2de-4c7f-8426-c4d73c34dcb8 tempest-VolumesSnapshotsTestJSON-648712039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a.1744b2e1-691e-41ec-8373-9e2ffb23ec85 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:32 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a.1744b2e1-691e-41ec-8373-9e2ffb23ec85 1G Sep 01 08:15:32 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:33 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-ed838cb7-3f98-4cd6-91ab-1523fb0101f9 req-925cc0e3-c2de-4c7f-8426-c4d73c34dcb8 tempest-VolumesSnapshotsTestJSON-648712039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a.1744b2e1-691e-41ec-8373-9e2ffb23ec85 1G" returned: 0 in 1.294s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-ed838cb7-3f98-4cd6-91ab-1523fb0101f9 req-925cc0e3-c2de-4c7f-8426-c4d73c34dcb8 tempest-VolumesSnapshotsTestJSON-648712039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17a05450-1fc4-467f-b1da-c970c5414e8a -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a.1744b2e1-691e-41ec-8373-9e2ffb23ec85 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:33 devstack sudo[89968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17a05450-1fc4-467f-b1da-c970c5414e8a -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a.1744b2e1-691e-41ec-8373-9e2ffb23ec85 Sep 01 08:15:33 devstack sudo[89968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:34 devstack sudo[89968]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-ed838cb7-3f98-4cd6-91ab-1523fb0101f9 req-925cc0e3-c2de-4c7f-8426-c4d73c34dcb8 tempest-VolumesSnapshotsTestJSON-648712039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17a05450-1fc4-467f-b1da-c970c5414e8a -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a.1744b2e1-691e-41ec-8373-9e2ffb23ec85" returned: 0 in 0.684s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:34 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [req-ed838cb7-3f98-4cd6-91ab-1523fb0101f9 req-925cc0e3-c2de-4c7f-8426-c4d73c34dcb8 tempest-VolumesSnapshotsTestJSON-648712039 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a.1744b2e1-691e-41ec-8373-9e2ffb23ec85 is being set with open permissions: ugo+rw Sep 01 08:15:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-ed838cb7-3f98-4cd6-91ab-1523fb0101f9 req-925cc0e3-c2de-4c7f-8426-c4d73c34dcb8 tempest-VolumesSnapshotsTestJSON-648712039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a.1744b2e1-691e-41ec-8373-9e2ffb23ec85 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:34 devstack sudo[90008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a.1744b2e1-691e-41ec-8373-9e2ffb23ec85 Sep 01 08:15:34 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:35 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-ed838cb7-3f98-4cd6-91ab-1523fb0101f9 req-925cc0e3-c2de-4c7f-8426-c4d73c34dcb8 tempest-VolumesSnapshotsTestJSON-648712039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a.1744b2e1-691e-41ec-8373-9e2ffb23ec85" returned: 0 in 0.566s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-ed838cb7-3f98-4cd6-91ab-1523fb0101f9 req-925cc0e3-c2de-4c7f-8426-c4d73c34dcb8 tempest-VolumesSnapshotsTestJSON-648712039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:35 devstack sudo[90013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a.info Sep 01 08:15:35 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:35 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-ed838cb7-3f98-4cd6-91ab-1523fb0101f9 req-925cc0e3-c2de-4c7f-8426-c4d73c34dcb8 tempest-VolumesSnapshotsTestJSON-648712039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a.info" returned: 0 in 0.666s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:35 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [req-ed838cb7-3f98-4cd6-91ab-1523fb0101f9 req-925cc0e3-c2de-4c7f-8426-c4d73c34dcb8 tempest-VolumesSnapshotsTestJSON-648712039 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a.info is being set with open permissions: ugo+rw Sep 01 08:15:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-ed838cb7-3f98-4cd6-91ab-1523fb0101f9 req-925cc0e3-c2de-4c7f-8426-c4d73c34dcb8 tempest-VolumesSnapshotsTestJSON-648712039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:35 devstack sudo[90040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a.info Sep 01 08:15:35 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:36 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-ed838cb7-3f98-4cd6-91ab-1523fb0101f9 req-925cc0e3-c2de-4c7f-8426-c4d73c34dcb8 tempest-VolumesSnapshotsTestJSON-648712039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a.info" returned: 0 in 0.559s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-ed838cb7-3f98-4cd6-91ab-1523fb0101f9 req-925cc0e3-c2de-4c7f-8426-c4d73c34dcb8 tempest-VolumesSnapshotsTestJSON-648712039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.737s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:15:36 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-ed838cb7-3f98-4cd6-91ab-1523fb0101f9 req-925cc0e3-c2de-4c7f-8426-c4d73c34dcb8 tempest-VolumesSnapshotsTestJSON-648712039 None] Create snapshot completed successfully Sep 01 08:15:36 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-8c639c87-ff08-4acb-b06b-b394ce440e4e req-3a4711ee-3be0-4d68-9c22-188f3dadab73 tempest-VolumesSnapshotsTestJSON-648712039 None] Acquiring lock "cinder-1744b2e1-691e-41ec-8373-9e2ffb23ec85-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:15:36 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-8c639c87-ff08-4acb-b06b-b394ce440e4e req-3a4711ee-3be0-4d68-9c22-188f3dadab73 tempest-VolumesSnapshotsTestJSON-648712039 None] Lock "cinder-1744b2e1-691e-41ec-8373-9e2ffb23ec85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:15:36 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-8c639c87-ff08-4acb-b06b-b394ce440e4e req-3a4711ee-3be0-4d68-9c22-188f3dadab73 tempest-VolumesSnapshotsTestJSON-648712039 None] Acquiring lock "cinder-quobyte-17a05450-1fc4-467f-b1da-c970c5414e8a" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:15:36 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-8c639c87-ff08-4acb-b06b-b394ce440e4e req-3a4711ee-3be0-4d68-9c22-188f3dadab73 tempest-VolumesSnapshotsTestJSON-648712039 None] Lock "cinder-quobyte-17a05450-1fc4-467f-b1da-c970c5414e8a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:15:36 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-8c639c87-ff08-4acb-b06b-b394ce440e4e req-3a4711ee-3be0-4d68-9c22-188f3dadab73 tempest-VolumesSnapshotsTestJSON-648712039 None] Acquiring lock "cinder-quobyte-1744b2e1-691e-41ec-8373-9e2ffb23ec85" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:15:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-8c639c87-ff08-4acb-b06b-b394ce440e4e req-3a4711ee-3be0-4d68-9c22-188f3dadab73 tempest-VolumesSnapshotsTestJSON-648712039 None] Lock "cinder-quobyte-1744b2e1-691e-41ec-8373-9e2ffb23ec85" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:15:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [req-8c639c87-ff08-4acb-b06b-b394ce440e4e req-3a4711ee-3be0-4d68-9c22-188f3dadab73 tempest-VolumesSnapshotsTestJSON-648712039 None] Deleting offline snapshot 1744b2e1-691e-41ec-8373-9e2ffb23ec85 of volume 17a05450-1fc4-467f-b1da-c970c5414e8a {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:15:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [req-8c639c87-ff08-4acb-b06b-b394ce440e4e req-3a4711ee-3be0-4d68-9c22-188f3dadab73 tempest-VolumesSnapshotsTestJSON-648712039 None] snapshot_file for this snap is: volume-17a05450-1fc4-467f-b1da-c970c5414e8a.1744b2e1-691e-41ec-8373-9e2ffb23ec85 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:15:37 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3bcc18-69b6-4051-b2e1-d308cfdd6282]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:15:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-8c639c87-ff08-4acb-b06b-b394ce440e4e req-3a4711ee-3be0-4d68-9c22-188f3dadab73 tempest-VolumesSnapshotsTestJSON-648712039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a.1744b2e1-691e-41ec-8373-9e2ffb23ec85 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:37 devstack sudo[90045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a.1744b2e1-691e-41ec-8373-9e2ffb23ec85 Sep 01 08:15:37 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:37 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-8c639c87-ff08-4acb-b06b-b394ce440e4e req-3a4711ee-3be0-4d68-9c22-188f3dadab73 tempest-VolumesSnapshotsTestJSON-648712039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a.1744b2e1-691e-41ec-8373-9e2ffb23ec85" returned: 0 in 0.405s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [req-8c639c87-ff08-4acb-b06b-b394ce440e4e req-3a4711ee-3be0-4d68-9c22-188f3dadab73 tempest-VolumesSnapshotsTestJSON-648712039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17a05450-1fc4-467f-b1da-c970c5414e8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:15:37 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[752c5b70-1b08-4c61-8d47-8d6dac71dc0e]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:15:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-8c639c87-ff08-4acb-b06b-b394ce440e4e req-3a4711ee-3be0-4d68-9c22-188f3dadab73 tempest-VolumesSnapshotsTestJSON-648712039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:37 devstack sudo[90050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a Sep 01 08:15:37 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:38 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-8c639c87-ff08-4acb-b06b-b394ce440e4e req-3a4711ee-3be0-4d68-9c22-188f3dadab73 tempest-VolumesSnapshotsTestJSON-648712039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a" returned: 0 in 0.490s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-8c639c87-ff08-4acb-b06b-b394ce440e4e req-3a4711ee-3be0-4d68-9c22-188f3dadab73 tempest-VolumesSnapshotsTestJSON-648712039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a.1744b2e1-691e-41ec-8373-9e2ffb23ec85 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:38 devstack sudo[90056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a.1744b2e1-691e-41ec-8373-9e2ffb23ec85 Sep 01 08:15:38 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:38 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-8c639c87-ff08-4acb-b06b-b394ce440e4e req-3a4711ee-3be0-4d68-9c22-188f3dadab73 tempest-VolumesSnapshotsTestJSON-648712039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a.1744b2e1-691e-41ec-8373-9e2ffb23ec85" returned: 0 in 0.484s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-8c639c87-ff08-4acb-b06b-b394ce440e4e req-3a4711ee-3be0-4d68-9c22-188f3dadab73 tempest-VolumesSnapshotsTestJSON-648712039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a.1744b2e1-691e-41ec-8373-9e2ffb23ec85 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:38 devstack sudo[90068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a.1744b2e1-691e-41ec-8373-9e2ffb23ec85 Sep 01 08:15:38 devstack sudo[90068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:38 devstack sudo[90068]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-8c639c87-ff08-4acb-b06b-b394ce440e4e req-3a4711ee-3be0-4d68-9c22-188f3dadab73 tempest-VolumesSnapshotsTestJSON-648712039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a.1744b2e1-691e-41ec-8373-9e2ffb23ec85" returned: 0 in 0.349s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:38 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-8c639c87-ff08-4acb-b06b-b394ce440e4e req-3a4711ee-3be0-4d68-9c22-188f3dadab73 tempest-VolumesSnapshotsTestJSON-648712039 None] Lock "cinder-quobyte-1744b2e1-691e-41ec-8373-9e2ffb23ec85" released by "_delete_snapshot" :: held 1.886s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:15:38 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-8c639c87-ff08-4acb-b06b-b394ce440e4e req-3a4711ee-3be0-4d68-9c22-188f3dadab73 tempest-VolumesSnapshotsTestJSON-648712039 None] Lock "cinder-quobyte-17a05450-1fc4-467f-b1da-c970c5414e8a" released by "delete_snapshot" :: held 1.921s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:15:38 devstack cinder-volume[86893]: WARNING cinder.quota [req-8c639c87-ff08-4acb-b06b-b394ce440e4e req-3a4711ee-3be0-4d68-9c22-188f3dadab73 tempest-VolumesSnapshotsTestJSON-648712039 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:15:38 devstack cinder-volume[86893]: DEBUG cinder.quota [req-8c639c87-ff08-4acb-b06b-b394ce440e4e req-3a4711ee-3be0-4d68-9c22-188f3dadab73 tempest-VolumesSnapshotsTestJSON-648712039 None] Created reservations ['4b6ae613-87e7-4f91-997b-644d8e91facc', '7c894cf6-90cd-4909-8870-80608bc54d2b', '6e22ad51-840c-483b-bf18-a26c264e683d', '22f700c5-0ea7-4c82-954d-f07f42b0adb6'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:15:39 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-8c639c87-ff08-4acb-b06b-b394ce440e4e req-3a4711ee-3be0-4d68-9c22-188f3dadab73 tempest-VolumesSnapshotsTestJSON-648712039 None] Delete snapshot completed successfully. Sep 01 08:15:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-8c639c87-ff08-4acb-b06b-b394ce440e4e req-3a4711ee-3be0-4d68-9c22-188f3dadab73 tempest-VolumesSnapshotsTestJSON-648712039 None] Lock "cinder-1744b2e1-691e-41ec-8373-9e2ffb23ec85-delete_snapshot" released by "delete_snapshot" :: held 2.087s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:15:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-a1f225a7-91a2-4824-a2c4-f9c1fd375aee req-c1746a55-bccc-41a8-adab-e63c5b9838e6 tempest-VolumesSnapshotsTestJSON-648712039 None] Acquiring lock "cinder-17a05450-1fc4-467f-b1da-c970c5414e8a-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:15:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-a1f225a7-91a2-4824-a2c4-f9c1fd375aee req-c1746a55-bccc-41a8-adab-e63c5b9838e6 tempest-VolumesSnapshotsTestJSON-648712039 None] Lock "cinder-17a05450-1fc4-467f-b1da-c970c5414e8a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:15:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-a1f225a7-91a2-4824-a2c4-f9c1fd375aee req-c1746a55-bccc-41a8-adab-e63c5b9838e6 tempest-VolumesSnapshotsTestJSON-648712039 None] Acquiring lock "cinder-quobyte-17a05450-1fc4-467f-b1da-c970c5414e8a" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:15:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-a1f225a7-91a2-4824-a2c4-f9c1fd375aee req-c1746a55-bccc-41a8-adab-e63c5b9838e6 tempest-VolumesSnapshotsTestJSON-648712039 None] Lock "cinder-quobyte-17a05450-1fc4-467f-b1da-c970c5414e8a" acquired by "delete_volume" :: waited 0.028s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:15:39 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e7e9b4-9192-4660-b3d9-e487a1ae8dad]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:15:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-a1f225a7-91a2-4824-a2c4-f9c1fd375aee req-c1746a55-bccc-41a8-adab-e63c5b9838e6 tempest-VolumesSnapshotsTestJSON-648712039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:39 devstack sudo[90091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a Sep 01 08:15:39 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:39 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-a1f225a7-91a2-4824-a2c4-f9c1fd375aee req-c1746a55-bccc-41a8-adab-e63c5b9838e6 tempest-VolumesSnapshotsTestJSON-648712039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a" returned: 0 in 0.425s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-a1f225a7-91a2-4824-a2c4-f9c1fd375aee req-c1746a55-bccc-41a8-adab-e63c5b9838e6 tempest-VolumesSnapshotsTestJSON-648712039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:39 devstack sudo[90099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a Sep 01 08:15:39 devstack sudo[90099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:40 devstack sudo[90099]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-a1f225a7-91a2-4824-a2c4-f9c1fd375aee req-c1746a55-bccc-41a8-adab-e63c5b9838e6 tempest-VolumesSnapshotsTestJSON-648712039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-17a05450-1fc4-467f-b1da-c970c5414e8a" returned: 0 in 0.261s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-a1f225a7-91a2-4824-a2c4-f9c1fd375aee req-c1746a55-bccc-41a8-adab-e63c5b9838e6 tempest-VolumesSnapshotsTestJSON-648712039 None] Lock "cinder-quobyte-17a05450-1fc4-467f-b1da-c970c5414e8a" released by "delete_volume" :: held 0.806s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:15:40 devstack cinder-volume[86893]: DEBUG cinder.quota [req-a1f225a7-91a2-4824-a2c4-f9c1fd375aee req-c1746a55-bccc-41a8-adab-e63c5b9838e6 tempest-VolumesSnapshotsTestJSON-648712039 None] Created reservations ['36f13c7a-fafa-49a7-8365-1f0183b6cd96', '95803760-6fd7-4b4d-97fb-9afb785c2b61', '65c6095f-7442-4284-b94a-1c4764745688', '72a7f120-075c-46a5-838e-9ac919a60393'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:15:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-a1f225a7-91a2-4824-a2c4-f9c1fd375aee req-c1746a55-bccc-41a8-adab-e63c5b9838e6 tempest-VolumesSnapshotsTestJSON-648712039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:15:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-a1f225a7-91a2-4824-a2c4-f9c1fd375aee req-c1746a55-bccc-41a8-adab-e63c5b9838e6 tempest-VolumesSnapshotsTestJSON-648712039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:15:40 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [req-a1f225a7-91a2-4824-a2c4-f9c1fd375aee req-c1746a55-bccc-41a8-adab-e63c5b9838e6 tempest-VolumesSnapshotsTestJSON-648712039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:15:40 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [req-a1f225a7-91a2-4824-a2c4-f9c1fd375aee req-c1746a55-bccc-41a8-adab-e63c5b9838e6 tempest-VolumesSnapshotsTestJSON-648712039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:15:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-a1f225a7-91a2-4824-a2c4-f9c1fd375aee req-c1746a55-bccc-41a8-adab-e63c5b9838e6 tempest-VolumesSnapshotsTestJSON-648712039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:15:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-a1f225a7-91a2-4824-a2c4-f9c1fd375aee req-c1746a55-bccc-41a8-adab-e63c5b9838e6 tempest-VolumesSnapshotsTestJSON-648712039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:40 devstack sudo[90102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:15:40 devstack sudo[90102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:40 devstack sudo[90102]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-a1f225a7-91a2-4824-a2c4-f9c1fd375aee req-c1746a55-bccc-41a8-adab-e63c5b9838e6 tempest-VolumesSnapshotsTestJSON-648712039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.356s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:40 devstack cinder-volume[86893]: DEBUG cinder.manager [req-a1f225a7-91a2-4824-a2c4-f9c1fd375aee req-c1746a55-bccc-41a8-adab-e63c5b9838e6 tempest-VolumesSnapshotsTestJSON-648712039 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:15:40 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-a1f225a7-91a2-4824-a2c4-f9c1fd375aee req-c1746a55-bccc-41a8-adab-e63c5b9838e6 tempest-VolumesSnapshotsTestJSON-648712039 None] Deleted volume successfully. Sep 01 08:15:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-a1f225a7-91a2-4824-a2c4-f9c1fd375aee req-c1746a55-bccc-41a8-adab-e63c5b9838e6 tempest-VolumesSnapshotsTestJSON-648712039 None] Lock "cinder-17a05450-1fc4-467f-b1da-c970c5414e8a-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:15:42 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:15:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] Flow 'volume_create_manager' (e0e0cd8c-f09a-4f29-8ac4-d036e80803ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:15:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b55b4d-2782-47a7-bdae-af2cd817c73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b55b4d-2782-47a7-bdae-af2cd817c73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1228699666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc66fd2e-948c-4148-853f-8f3e7fed7e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106da3b99b7f4b8f9f66a16984d10389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:15:42Z,use_quota=True,user_id='8628dd2ba74041869be9ce09747356ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184d457e-f7e0-44a1-8788-3de077103774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184d457e-f7e0-44a1-8788-3de077103774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5d4e078-9a02-495d-be34-9999908d28b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5d4e078-9a02-495d-be34-9999908d28b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc66fd2e-948c-4148-853f-8f3e7fed7e4e', 'volume_name': 'volume-bc66fd2e-948c-4148-853f-8f3e7fed7e4e', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48477512-fdf8-4cd4-a8ae-c8998ec894e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48477512-fdf8-4cd4-a8ae-c8998ec894e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62290f43-280f-4dbf-ab59-c02e8689a8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:42 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] Volume bc66fd2e-948c-4148-853f-8f3e7fed7e4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc66fd2e-948c-4148-853f-8f3e7fed7e4e', 'volume_size': 1} Sep 01 08:15:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:15:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:15:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1228699666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc66fd2e-948c-4148-853f-8f3e7fed7e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106da3b99b7f4b8f9f66a16984d10389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:15:42Z,use_quota=True,user_id='8628dd2ba74041869be9ce09747356ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:15:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] Creating volume bc66fd2e-948c-4148-853f-8f3e7fed7e4e {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:15:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:15:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:15:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:15:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:15:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:15:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:15:42 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:15:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bc66fd2e-948c-4148-853f-8f3e7fed7e4e 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:42 devstack sudo[90108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bc66fd2e-948c-4148-853f-8f3e7fed7e4e 1073741824 Sep 01 08:15:42 devstack sudo[90108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:42 devstack sudo[90108]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bc66fd2e-948c-4148-853f-8f3e7fed7e4e 1073741824" returned: 0 in 0.450s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bc66fd2e-948c-4148-853f-8f3e7fed7e4e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:42 devstack sudo[90114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bc66fd2e-948c-4148-853f-8f3e7fed7e4e Sep 01 08:15:42 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:42 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bc66fd2e-948c-4148-853f-8f3e7fed7e4e" returned: 0 in 0.273s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:15:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:15:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62290f43-280f-4dbf-ab59-c02e8689a8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc66fd2e-948c-4148-853f-8f3e7fed7e4e', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d56be27-a2ed-4598-bcb6-c32fca081c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:43 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] Volume volume-bc66fd2e-948c-4148-853f-8f3e7fed7e4e (bc66fd2e-948c-4148-853f-8f3e7fed7e4e): created successfully Sep 01 08:15:43 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d56be27-a2ed-4598-bcb6-c32fca081c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:43 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] Flow 'volume_create_manager' (e0e0cd8c-f09a-4f29-8ac4-d036e80803ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:15:43 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-70a11dac-a206-4ab8-a78d-a0afe26df5f9 tempest-ServersNegativeTestJSON-990635982 None] Created volume successfully. Sep 01 08:15:44 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:15:44 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] Flow 'volume_create_manager' (6e3f4105-b4f1-4891-862d-a20012b3e811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:15:44 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1307cf5e-6a20-48fc-9618-af94dc67b825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:44 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1307cf5e-6a20-48fc-9618-af94dc67b825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2063414978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22204264-a063-49c9-b2af-4fdd2ec6ce61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c735d4e612b94af7947e614d9d0a896b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:15:44Z,use_quota=True,user_id='ebc79b04914d450db588437c83cca103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:44 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4befcda3-2c5e-4bb2-a117-912d6a2e5a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:44 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4befcda3-2c5e-4bb2-a117-912d6a2e5a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:44 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b876f8a-80fe-4f14-bb10-1d8d49369083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:44 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b876f8a-80fe-4f14-bb10-1d8d49369083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22204264-a063-49c9-b2af-4fdd2ec6ce61', 'volume_name': 'volume-22204264-a063-49c9-b2af-4fdd2ec6ce61', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:44 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0974415b-aebf-4911-a5c1-1cacd628263d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:44 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0974415b-aebf-4911-a5c1-1cacd628263d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:44 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7950594-c558-4cfa-ba2d-437ce8a98fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:44 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] Volume 22204264-a063-49c9-b2af-4fdd2ec6ce61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22204264-a063-49c9-b2af-4fdd2ec6ce61', 'volume_size': 1} Sep 01 08:15:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:15:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:15:44 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2063414978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22204264-a063-49c9-b2af-4fdd2ec6ce61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c735d4e612b94af7947e614d9d0a896b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:15:44Z,use_quota=True,user_id='ebc79b04914d450db588437c83cca103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:15:44 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] Creating volume 22204264-a063-49c9-b2af-4fdd2ec6ce61 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:15:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:15:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:15:44 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:15:44 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:15:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:15:44 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:15:44 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:15:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-22204264-a063-49c9-b2af-4fdd2ec6ce61 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:44 devstack sudo[90119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-22204264-a063-49c9-b2af-4fdd2ec6ce61 1073741824 Sep 01 08:15:44 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:44 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-22204264-a063-49c9-b2af-4fdd2ec6ce61 1073741824" returned: 0 in 0.684s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-22204264-a063-49c9-b2af-4fdd2ec6ce61 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:45 devstack sudo[90125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-22204264-a063-49c9-b2af-4fdd2ec6ce61 Sep 01 08:15:45 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:45 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-22204264-a063-49c9-b2af-4fdd2ec6ce61" returned: 0 in 0.344s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:45 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:15:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:15:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7950594-c558-4cfa-ba2d-437ce8a98fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22204264-a063-49c9-b2af-4fdd2ec6ce61', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3046914-7859-45e2-8de9-bd8bc6877dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:45 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] Volume volume-22204264-a063-49c9-b2af-4fdd2ec6ce61 (22204264-a063-49c9-b2af-4fdd2ec6ce61): created successfully Sep 01 08:15:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3046914-7859-45e2-8de9-bd8bc6877dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] Flow 'volume_create_manager' (6e3f4105-b4f1-4891-862d-a20012b3e811) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:15:45 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-33dc4e66-d343-426d-8142-c74d862fc8f1 tempest-ServerActionsTestOtherA-1037332526 None] Created volume successfully. Sep 01 08:15:46 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-bbcf6992-ac8a-480d-9458-eaac9c686547 tempest-GroupSnapshotsV319Test-1291919367 None] Group tempest-GroupSnapshotsV319Test-Group-1138253378: creating Sep 01 08:15:46 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-bbcf6992-ac8a-480d-9458-eaac9c686547 tempest-GroupSnapshotsV319Test-1291919367 None] Group tempest-GroupSnapshotsV319Test-Group-1138253378: created successfully Sep 01 08:15:46 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-bbcf6992-ac8a-480d-9458-eaac9c686547 tempest-GroupSnapshotsV319Test-1291919367 None] Create group completed successfully. Sep 01 08:15:46 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:15:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] Flow 'volume_create_manager' (b17da87b-24b4-4384-8d62-d2179582b4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:15:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac14bba-f55e-4d5a-ae2a-cb64cb09b061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac14bba-f55e-4d5a-ae2a-cb64cb09b061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1748808434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbc6bef3-51b9-4daf-803a-2d939d3d89f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106da3b99b7f4b8f9f66a16984d10389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:15:47Z,use_quota=True,user_id='8628dd2ba74041869be9ce09747356ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (041fbbc1-9509-4853-a1b8-007d4d2e41a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (041fbbc1-9509-4853-a1b8-007d4d2e41a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aad6933-f323-41c3-8caa-33bb414d3834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aad6933-f323-41c3-8caa-33bb414d3834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbc6bef3-51b9-4daf-803a-2d939d3d89f1', 'volume_name': 'volume-fbc6bef3-51b9-4daf-803a-2d939d3d89f1', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10101032-9452-4299-aaf0-36ccf642e1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10101032-9452-4299-aaf0-36ccf642e1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be284233-c54d-4917-bb85-8855bc0ebc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:46 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] Volume fbc6bef3-51b9-4daf-803a-2d939d3d89f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbc6bef3-51b9-4daf-803a-2d939d3d89f1', 'volume_size': 1} Sep 01 08:15:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:15:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:15:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1748808434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbc6bef3-51b9-4daf-803a-2d939d3d89f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106da3b99b7f4b8f9f66a16984d10389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:15:47Z,use_quota=True,user_id='8628dd2ba74041869be9ce09747356ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:15:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] Creating volume fbc6bef3-51b9-4daf-803a-2d939d3d89f1 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:15:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:15:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:15:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:15:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:15:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:15:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:15:46 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:15:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fbc6bef3-51b9-4daf-803a-2d939d3d89f1 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:46 devstack sudo[90129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fbc6bef3-51b9-4daf-803a-2d939d3d89f1 1073741824 Sep 01 08:15:46 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:47 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fbc6bef3-51b9-4daf-803a-2d939d3d89f1 1073741824" returned: 0 in 0.507s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fbc6bef3-51b9-4daf-803a-2d939d3d89f1 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:47 devstack sudo[90135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fbc6bef3-51b9-4daf-803a-2d939d3d89f1 Sep 01 08:15:47 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:47 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fbc6bef3-51b9-4daf-803a-2d939d3d89f1" returned: 0 in 0.376s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:15:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:15:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be284233-c54d-4917-bb85-8855bc0ebc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbc6bef3-51b9-4daf-803a-2d939d3d89f1', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75173100-3c1f-42f7-96fa-ef5753f981a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:47 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] Volume volume-fbc6bef3-51b9-4daf-803a-2d939d3d89f1 (fbc6bef3-51b9-4daf-803a-2d939d3d89f1): created successfully Sep 01 08:15:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75173100-3c1f-42f7-96fa-ef5753f981a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] Flow 'volume_create_manager' (b17da87b-24b4-4384-8d62-d2179582b4ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:15:47 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-91f43aca-e6a4-4976-a64c-7d290f111bce tempest-ServersNegativeTestJSON-990635982 None] Created volume successfully. Sep 01 08:15:48 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:15:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] Flow 'volume_create_manager' (0c9838b6-614b-4e0a-8049-c976400a184d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:15:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec4398f7-eb1d-4beb-bebb-08f0a8df371b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec4398f7-eb1d-4beb-bebb-08f0a8df371b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1836653155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8de14972-8717-44cc-a934-fa8a1b78020b,host='devstack@QuobyteHD#QuobyteHD',id=2c4037ca-ef95-4819-b6ef-f9cf5a3a9057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0545a4c28a774db58f35194fcaa73a67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:15:48Z,use_quota=True,user_id='2a387f34dd2647fa841f556dde0e2032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df915640-ddda-46bc-8e87-9553190d9b1a),volume_type_id=df915640-ddda-46bc-8e87-9553190d9b1a)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86c98212-8926-48a8-a5ae-b70f80226b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86c98212-8926-48a8-a5ae-b70f80226b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a44ea4a-6653-4581-af6d-05bca31ba486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a44ea4a-6653-4581-af6d-05bca31ba486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c4037ca-ef95-4819-b6ef-f9cf5a3a9057', 'volume_name': 'volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7a72e2f-e8fe-4cd5-bf5e-fd2cc3d876ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7a72e2f-e8fe-4cd5-bf5e-fd2cc3d876ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (892ddd8b-0174-4eb9-9630-d71e12175347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:48 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] Volume 2c4037ca-ef95-4819-b6ef-f9cf5a3a9057: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057', 'volume_size': 1} Sep 01 08:15:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:15:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:15:48 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8de14972-8717-44cc-a934-fa8a1b78020b,created_at=2026-09-01T06:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1836653155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8de14972-8717-44cc-a934-fa8a1b78020b,host='devstack@QuobyteHD#QuobyteHD',id=2c4037ca-ef95-4819-b6ef-f9cf5a3a9057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0545a4c28a774db58f35194fcaa73a67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:15:48Z,use_quota=True,user_id='2a387f34dd2647fa841f556dde0e2032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df915640-ddda-46bc-8e87-9553190d9b1a),volume_type_id=df915640-ddda-46bc-8e87-9553190d9b1a)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:15:48 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] Creating volume 2c4037ca-ef95-4819-b6ef-f9cf5a3a9057 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:15:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:15:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:15:48 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:15:48 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:15:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:15:48 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:15:48 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:15:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:48 devstack sudo[90138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057 1073741824 Sep 01 08:15:48 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:48 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057 1073741824" returned: 0 in 0.614s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:48 devstack sudo[90147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057 Sep 01 08:15:48 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:49 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057" returned: 0 in 0.333s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:49 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:15:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:15:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (892ddd8b-0174-4eb9-9630-d71e12175347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d76e59-4eff-4add-8b4a-693be6fcf511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:49 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] Volume volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057 (2c4037ca-ef95-4819-b6ef-f9cf5a3a9057): created successfully Sep 01 08:15:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d76e59-4eff-4add-8b4a-693be6fcf511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] Flow 'volume_create_manager' (0c9838b6-614b-4e0a-8049-c976400a184d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:15:49 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-64ef790d-4aca-463d-9c53-d38baa882a47 tempest-GroupSnapshotsV319Test-1291919367 None] Created volume successfully. Sep 01 08:15:49 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7490d9a0-3104-45ad-860d-526657ac8acb tempest-ServersNegativeTestJSON-990635982 None] Acquiring lock "cinder-fbc6bef3-51b9-4daf-803a-2d939d3d89f1-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:15:49 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7490d9a0-3104-45ad-860d-526657ac8acb tempest-ServersNegativeTestJSON-990635982 None] Lock "cinder-fbc6bef3-51b9-4daf-803a-2d939d3d89f1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:15:49 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7490d9a0-3104-45ad-860d-526657ac8acb tempest-ServersNegativeTestJSON-990635982 None] Acquiring lock "cinder-quobyte-fbc6bef3-51b9-4daf-803a-2d939d3d89f1" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:15:49 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7490d9a0-3104-45ad-860d-526657ac8acb tempest-ServersNegativeTestJSON-990635982 None] Lock "cinder-quobyte-fbc6bef3-51b9-4daf-803a-2d939d3d89f1" acquired by "delete_volume" :: waited 0.027s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:15:49 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[8220b759-4f75-40ab-913a-3b6366b7eeb2]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:15:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7490d9a0-3104-45ad-860d-526657ac8acb tempest-ServersNegativeTestJSON-990635982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fbc6bef3-51b9-4daf-803a-2d939d3d89f1 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:49 devstack sudo[90153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fbc6bef3-51b9-4daf-803a-2d939d3d89f1 Sep 01 08:15:49 devstack sudo[90153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:50 devstack sudo[90153]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7490d9a0-3104-45ad-860d-526657ac8acb tempest-ServersNegativeTestJSON-990635982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fbc6bef3-51b9-4daf-803a-2d939d3d89f1" returned: 0 in 0.536s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7490d9a0-3104-45ad-860d-526657ac8acb tempest-ServersNegativeTestJSON-990635982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fbc6bef3-51b9-4daf-803a-2d939d3d89f1 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:50 devstack sudo[90159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fbc6bef3-51b9-4daf-803a-2d939d3d89f1 Sep 01 08:15:50 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:50 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7490d9a0-3104-45ad-860d-526657ac8acb tempest-ServersNegativeTestJSON-990635982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fbc6bef3-51b9-4daf-803a-2d939d3d89f1" returned: 0 in 0.363s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:50 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7490d9a0-3104-45ad-860d-526657ac8acb tempest-ServersNegativeTestJSON-990635982 None] Lock "cinder-quobyte-fbc6bef3-51b9-4daf-803a-2d939d3d89f1" released by "delete_volume" :: held 0.960s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:15:50 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-7490d9a0-3104-45ad-860d-526657ac8acb tempest-ServersNegativeTestJSON-990635982 None] Created reservations ['d6b76ea5-10dc-4960-8f8f-1e71e311db4f', 'b9dbe8f2-8d24-4e06-bff3-73c2464d0b6b', '67bd9e81-c402-4672-9e4d-30bdd0401e1d', 'ba785b16-c821-40e2-9e8b-c1f366c09ef9'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:15:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7490d9a0-3104-45ad-860d-526657ac8acb tempest-ServersNegativeTestJSON-990635982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:15:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7490d9a0-3104-45ad-860d-526657ac8acb tempest-ServersNegativeTestJSON-990635982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:15:50 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7490d9a0-3104-45ad-860d-526657ac8acb tempest-ServersNegativeTestJSON-990635982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:15:50 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7490d9a0-3104-45ad-860d-526657ac8acb tempest-ServersNegativeTestJSON-990635982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:15:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7490d9a0-3104-45ad-860d-526657ac8acb tempest-ServersNegativeTestJSON-990635982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:15:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7490d9a0-3104-45ad-860d-526657ac8acb tempest-ServersNegativeTestJSON-990635982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:50 devstack sudo[90178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:15:50 devstack sudo[90178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:50 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7459458c-a476-4f03-9597-4af4bd1501a5 tempest-ServersNegativeTestJSON-990635982 None] Acquiring lock "cinder-bc66fd2e-948c-4148-853f-8f3e7fed7e4e-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:15:50 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7459458c-a476-4f03-9597-4af4bd1501a5 tempest-ServersNegativeTestJSON-990635982 None] Lock "cinder-bc66fd2e-948c-4148-853f-8f3e7fed7e4e-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Flow 'volume_create_manager' (7bcf2c6b-8133-4d11-b5ee-9ad902df32cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c155ddc3-f5d0-4b09-b81a-e76ba33e523f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c155ddc3-f5d0-4b09-b81a-e76ba33e523f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-736618255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f7fec58-8ccf-4703-9ff1-54f4341a03f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e82faf1989e043a7bc86e2176dd11f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:15:51Z,use_quota=True,user_id='029b45226bab47c393ab35f2b9870f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17857495-bcc4-47df-8abf-2512ca2a68bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17857495-bcc4-47df-8abf-2512ca2a68bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d81fba82-d253-49d7-90bc-743fead86d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d81fba82-d253-49d7-90bc-743fead86d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f7fec58-8ccf-4703-9ff1-54f4341a03f3', 'volume_name': 'volume-5f7fec58-8ccf-4703-9ff1-54f4341a03f3', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d18763-632b-45fc-83d4-d9ed951da762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d18763-632b-45fc-83d4-d9ed951da762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e6125d-570b-4645-893e-f88379853960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:51 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Volume 5f7fec58-8ccf-4703-9ff1-54f4341a03f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f7fec58-8ccf-4703-9ff1-54f4341a03f3', 'volume_size': 1} Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-736618255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f7fec58-8ccf-4703-9ff1-54f4341a03f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e82faf1989e043a7bc86e2176dd11f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:15:51Z,use_quota=True,user_id='029b45226bab47c393ab35f2b9870f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Creating volume 5f7fec58-8ccf-4703-9ff1-54f4341a03f3 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:15:51 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5f7fec58-8ccf-4703-9ff1-54f4341a03f3 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:51 devstack sudo[90178]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:51 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-8256c7d3-b1e9-4d94-a606-b4d47032f4eb tempest-GroupSnapshotsV319Test-1291919367 None] GroupSnapshot 51fe37a5-71da-4f1c-a056-4fd89adff42c: creating. Sep 01 08:15:51 devstack sudo[90181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5f7fec58-8ccf-4703-9ff1-54f4341a03f3 1073741824 Sep 01 08:15:51 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7490d9a0-3104-45ad-860d-526657ac8acb tempest-ServersNegativeTestJSON-990635982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.464s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-7490d9a0-3104-45ad-860d-526657ac8acb tempest-ServersNegativeTestJSON-990635982 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:15:51 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-7490d9a0-3104-45ad-860d-526657ac8acb tempest-ServersNegativeTestJSON-990635982 None] Deleted volume successfully. Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7459458c-a476-4f03-9597-4af4bd1501a5 tempest-ServersNegativeTestJSON-990635982 None] Acquiring lock "cinder-quobyte-bc66fd2e-948c-4148-853f-8f3e7fed7e4e" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8256c7d3-b1e9-4d94-a606-b4d47032f4eb tempest-GroupSnapshotsV319Test-1291919367 None] Group snapshot 51fe37a5-71da-4f1c-a056-4fd89adff42c: creating. {{(pid=86893) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8256c7d3-b1e9-4d94-a606-b4d47032f4eb tempest-GroupSnapshotsV319Test-1291919367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7459458c-a476-4f03-9597-4af4bd1501a5 tempest-ServersNegativeTestJSON-990635982 None] Lock "cinder-quobyte-bc66fd2e-948c-4148-853f-8f3e7fed7e4e" acquired by "delete_volume" :: waited 0.027s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[949fecbd-84a9-4d53-b200-f1143def9239]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7459458c-a476-4f03-9597-4af4bd1501a5 tempest-ServersNegativeTestJSON-990635982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bc66fd2e-948c-4148-853f-8f3e7fed7e4e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7490d9a0-3104-45ad-860d-526657ac8acb tempest-ServersNegativeTestJSON-990635982 None] Lock "cinder-fbc6bef3-51b9-4daf-803a-2d939d3d89f1-delete_volume" released by "delete_volume" :: held 2.028s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:15:51 devstack sudo[90183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bc66fd2e-948c-4148-853f-8f3e7fed7e4e Sep 01 08:15:51 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:51 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5f7fec58-8ccf-4703-9ff1-54f4341a03f3 1073741824" returned: 0 in 0.521s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5f7fec58-8ccf-4703-9ff1-54f4341a03f3 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:51 devstack sudo[90190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5f7fec58-8ccf-4703-9ff1-54f4341a03f3 Sep 01 08:15:51 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:51 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7459458c-a476-4f03-9597-4af4bd1501a5 tempest-ServersNegativeTestJSON-990635982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bc66fd2e-948c-4148-853f-8f3e7fed7e4e" returned: 0 in 0.468s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7459458c-a476-4f03-9597-4af4bd1501a5 tempest-ServersNegativeTestJSON-990635982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bc66fd2e-948c-4148-853f-8f3e7fed7e4e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:51 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bc66fd2e-948c-4148-853f-8f3e7fed7e4e Sep 01 08:15:51 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:52 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5f7fec58-8ccf-4703-9ff1-54f4341a03f3" returned: 0 in 0.276s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:15:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:15:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8256c7d3-b1e9-4d94-a606-b4d47032f4eb tempest-GroupSnapshotsV319Test-1291919367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.686s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:15:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e6125d-570b-4645-893e-f88379853960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f7fec58-8ccf-4703-9ff1-54f4341a03f3', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb14fed-daef-4cf0-9de9-d36d217b6ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:15:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-8256c7d3-b1e9-4d94-a606-b4d47032f4eb tempest-GroupSnapshotsV319Test-1291919367 None] Creating offline snapshot 9bbc45f5-09ea-4b26-9f52-8b1eaf4306eb of volume 2c4037ca-ef95-4819-b6ef-f9cf5a3a9057 {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:15:52 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Volume volume-5f7fec58-8ccf-4703-9ff1-54f4341a03f3 (5f7fec58-8ccf-4703-9ff1-54f4341a03f3): created successfully Sep 01 08:15:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb14fed-daef-4cf0-9de9-d36d217b6ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:15:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Flow 'volume_create_manager' (7bcf2c6b-8133-4d11-b5ee-9ad902df32cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:15:52 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9274a7-3652-49e7-aaf1-9c8aa0197863]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:15:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8256c7d3-b1e9-4d94-a606-b4d47032f4eb tempest-GroupSnapshotsV319Test-1291919367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:52 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7459458c-a476-4f03-9597-4af4bd1501a5 tempest-ServersNegativeTestJSON-990635982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bc66fd2e-948c-4148-853f-8f3e7fed7e4e" returned: 0 in 0.297s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:52 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-dbed7c62-3e35-46d5-9ae3-549ebc7dc024 tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Created volume successfully. Sep 01 08:15:52 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7459458c-a476-4f03-9597-4af4bd1501a5 tempest-ServersNegativeTestJSON-990635982 None] Lock "cinder-quobyte-bc66fd2e-948c-4148-853f-8f3e7fed7e4e" released by "delete_volume" :: held 0.817s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:15:52 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-7459458c-a476-4f03-9597-4af4bd1501a5 tempest-ServersNegativeTestJSON-990635982 None] Created reservations ['b3c28d1f-8e14-4239-93d4-7949dec0c906', 'ec7eb26d-0269-4d24-9b1b-5316b4bac579', '3e455d46-3bef-4344-94d6-70dc5a28d55c', 'b22e3485-89c1-45d7-9025-abe05530b92c'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:15:52 devstack sudo[90198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057 Sep 01 08:15:52 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7459458c-a476-4f03-9597-4af4bd1501a5 tempest-ServersNegativeTestJSON-990635982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:15:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7459458c-a476-4f03-9597-4af4bd1501a5 tempest-ServersNegativeTestJSON-990635982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:15:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7459458c-a476-4f03-9597-4af4bd1501a5 tempest-ServersNegativeTestJSON-990635982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:15:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7459458c-a476-4f03-9597-4af4bd1501a5 tempest-ServersNegativeTestJSON-990635982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:15:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7459458c-a476-4f03-9597-4af4bd1501a5 tempest-ServersNegativeTestJSON-990635982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:15:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7459458c-a476-4f03-9597-4af4bd1501a5 tempest-ServersNegativeTestJSON-990635982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:52 devstack sudo[90202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:15:52 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:52 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7459458c-a476-4f03-9597-4af4bd1501a5 tempest-ServersNegativeTestJSON-990635982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.279s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:52 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-7459458c-a476-4f03-9597-4af4bd1501a5 tempest-ServersNegativeTestJSON-990635982 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:15:52 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:52 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-7459458c-a476-4f03-9597-4af4bd1501a5 tempest-ServersNegativeTestJSON-990635982 None] Deleted volume successfully. Sep 01 08:15:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8256c7d3-b1e9-4d94-a606-b4d47032f4eb tempest-GroupSnapshotsV319Test-1291919367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057" returned: 0 in 0.485s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8256c7d3-b1e9-4d94-a606-b4d47032f4eb tempest-GroupSnapshotsV319Test-1291919367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057.9bbc45f5-09ea-4b26-9f52-8b1eaf4306eb 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:52 devstack sudo[90208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057.9bbc45f5-09ea-4b26-9f52-8b1eaf4306eb 1G Sep 01 08:15:52 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:52 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7459458c-a476-4f03-9597-4af4bd1501a5 tempest-ServersNegativeTestJSON-990635982 None] Lock "cinder-bc66fd2e-948c-4148-853f-8f3e7fed7e4e-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:15:53 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8256c7d3-b1e9-4d94-a606-b4d47032f4eb tempest-GroupSnapshotsV319Test-1291919367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057.9bbc45f5-09ea-4b26-9f52-8b1eaf4306eb 1G" returned: 0 in 0.628s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8256c7d3-b1e9-4d94-a606-b4d47032f4eb tempest-GroupSnapshotsV319Test-1291919367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057.9bbc45f5-09ea-4b26-9f52-8b1eaf4306eb {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:53 devstack sudo[90238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057.9bbc45f5-09ea-4b26-9f52-8b1eaf4306eb Sep 01 08:15:53 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:53 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8256c7d3-b1e9-4d94-a606-b4d47032f4eb tempest-GroupSnapshotsV319Test-1291919367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057.9bbc45f5-09ea-4b26-9f52-8b1eaf4306eb" returned: 0 in 0.558s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:53 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-8256c7d3-b1e9-4d94-a606-b4d47032f4eb tempest-GroupSnapshotsV319Test-1291919367 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057.9bbc45f5-09ea-4b26-9f52-8b1eaf4306eb is being set with open permissions: ugo+rw: NotImplementedError Sep 01 08:15:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8256c7d3-b1e9-4d94-a606-b4d47032f4eb tempest-GroupSnapshotsV319Test-1291919367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057.9bbc45f5-09ea-4b26-9f52-8b1eaf4306eb {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:53 devstack sudo[90262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057.9bbc45f5-09ea-4b26-9f52-8b1eaf4306eb Sep 01 08:15:53 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:54 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8256c7d3-b1e9-4d94-a606-b4d47032f4eb tempest-GroupSnapshotsV319Test-1291919367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057.9bbc45f5-09ea-4b26-9f52-8b1eaf4306eb" returned: 0 in 0.644s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8256c7d3-b1e9-4d94-a606-b4d47032f4eb tempest-GroupSnapshotsV319Test-1291919367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:54 devstack sudo[90284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057.info Sep 01 08:15:54 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:54 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8256c7d3-b1e9-4d94-a606-b4d47032f4eb tempest-GroupSnapshotsV319Test-1291919367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057.info" returned: 0 in 0.362s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:54 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-8256c7d3-b1e9-4d94-a606-b4d47032f4eb tempest-GroupSnapshotsV319Test-1291919367 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 08:15:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8256c7d3-b1e9-4d94-a606-b4d47032f4eb tempest-GroupSnapshotsV319Test-1291919367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:55 devstack sudo[90291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057.info Sep 01 08:15:55 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:55 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8256c7d3-b1e9-4d94-a606-b4d47032f4eb tempest-GroupSnapshotsV319Test-1291919367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057.info" returned: 0 in 0.670s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8256c7d3-b1e9-4d94-a606-b4d47032f4eb tempest-GroupSnapshotsV319Test-1291919367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.600s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:15:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-de173092-4b75-428c-963d-1ee605aa95be tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Acquiring lock "cinder-5f7fec58-8ccf-4703-9ff1-54f4341a03f3-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:15:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-de173092-4b75-428c-963d-1ee605aa95be tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Lock "cinder-5f7fec58-8ccf-4703-9ff1-54f4341a03f3-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:15:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-de173092-4b75-428c-963d-1ee605aa95be tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Acquiring lock "cinder-quobyte-5f7fec58-8ccf-4703-9ff1-54f4341a03f3" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:15:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-de173092-4b75-428c-963d-1ee605aa95be tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Lock "cinder-quobyte-5f7fec58-8ccf-4703-9ff1-54f4341a03f3" acquired by "delete_volume" :: waited 0.030s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:15:55 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-8256c7d3-b1e9-4d94-a606-b4d47032f4eb tempest-GroupSnapshotsV319Test-1291919367 None] group_snapshot 51fe37a5-71da-4f1c-a056-4fd89adff42c: created successfully Sep 01 08:15:55 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f9fccc-eeaf-4075-a8ed-fc528df0d189]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:15:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-de173092-4b75-428c-963d-1ee605aa95be tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5f7fec58-8ccf-4703-9ff1-54f4341a03f3 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:56 devstack sudo[90297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5f7fec58-8ccf-4703-9ff1-54f4341a03f3 Sep 01 08:15:56 devstack sudo[90297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:56 devstack sudo[90297]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-de173092-4b75-428c-963d-1ee605aa95be tempest-VolumeQuotasNegativeTestJSON-1346403232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5f7fec58-8ccf-4703-9ff1-54f4341a03f3" returned: 0 in 0.490s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-de173092-4b75-428c-963d-1ee605aa95be tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5f7fec58-8ccf-4703-9ff1-54f4341a03f3 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:56 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5f7fec58-8ccf-4703-9ff1-54f4341a03f3 Sep 01 08:15:56 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:56 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-de173092-4b75-428c-963d-1ee605aa95be tempest-VolumeQuotasNegativeTestJSON-1346403232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5f7fec58-8ccf-4703-9ff1-54f4341a03f3" returned: 0 in 0.524s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-de173092-4b75-428c-963d-1ee605aa95be tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Lock "cinder-quobyte-5f7fec58-8ccf-4703-9ff1-54f4341a03f3" released by "delete_volume" :: held 1.121s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:15:57 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-de173092-4b75-428c-963d-1ee605aa95be tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Created reservations ['6e752239-42b8-4e44-b299-211c884a74e0', '1c4892fe-77d0-4df0-ae0f-811c28b64927', '5f4c593c-f267-4410-99d1-50a4e43874d6', '2cb7ca7b-0d2c-4928-ab8b-fdf67bcd1596'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:15:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-de173092-4b75-428c-963d-1ee605aa95be tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:15:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-de173092-4b75-428c-963d-1ee605aa95be tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:15:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-de173092-4b75-428c-963d-1ee605aa95be tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:15:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-de173092-4b75-428c-963d-1ee605aa95be tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:15:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-de173092-4b75-428c-963d-1ee605aa95be tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:15:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-de173092-4b75-428c-963d-1ee605aa95be tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:57 devstack sudo[90307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:15:57 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:57 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-d028ad62-6db4-4bf2-a0d3-338b8ae268b4 tempest-GroupSnapshotsV319Test-1291919367 None] group_snapshot 51fe37a5-71da-4f1c-a056-4fd89adff42c: deleting Sep 01 08:15:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d028ad62-6db4-4bf2-a0d3-338b8ae268b4 tempest-GroupSnapshotsV319Test-1291919367 None] group_snapshot 51fe37a5-71da-4f1c-a056-4fd89adff42c: deleting {{(pid=86893) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 08:15:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d028ad62-6db4-4bf2-a0d3-338b8ae268b4 tempest-GroupSnapshotsV319Test-1291919367 None] Acquiring lock "cinder-quobyte-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:15:58 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d028ad62-6db4-4bf2-a0d3-338b8ae268b4 tempest-GroupSnapshotsV319Test-1291919367 None] Lock "cinder-quobyte-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057" acquired by "delete_snapshot" :: waited 0.058s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:15:58 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d028ad62-6db4-4bf2-a0d3-338b8ae268b4 tempest-GroupSnapshotsV319Test-1291919367 None] Acquiring lock "cinder-quobyte-9bbc45f5-09ea-4b26-9f52-8b1eaf4306eb" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:15:58 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d028ad62-6db4-4bf2-a0d3-338b8ae268b4 tempest-GroupSnapshotsV319Test-1291919367 None] Lock "cinder-quobyte-9bbc45f5-09ea-4b26-9f52-8b1eaf4306eb" acquired by "_delete_snapshot" :: waited 0.072s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:15:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-d028ad62-6db4-4bf2-a0d3-338b8ae268b4 tempest-GroupSnapshotsV319Test-1291919367 None] Deleting offline snapshot 9bbc45f5-09ea-4b26-9f52-8b1eaf4306eb of volume 2c4037ca-ef95-4819-b6ef-f9cf5a3a9057 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:15:58 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-d028ad62-6db4-4bf2-a0d3-338b8ae268b4 tempest-GroupSnapshotsV319Test-1291919367 None] snapshot_file for this snap is: volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057.9bbc45f5-09ea-4b26-9f52-8b1eaf4306eb {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:15:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-de173092-4b75-428c-963d-1ee605aa95be tempest-VolumeQuotasNegativeTestJSON-1346403232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.824s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:58 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-de173092-4b75-428c-963d-1ee605aa95be tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:15:58 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-de173092-4b75-428c-963d-1ee605aa95be tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Deleted volume successfully. Sep 01 08:15:58 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0edcaf2-ba84-46ed-b041-41766f49dec7]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:15:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d028ad62-6db4-4bf2-a0d3-338b8ae268b4 tempest-GroupSnapshotsV319Test-1291919367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057.9bbc45f5-09ea-4b26-9f52-8b1eaf4306eb {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:58 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-de173092-4b75-428c-963d-1ee605aa95be tempest-VolumeQuotasNegativeTestJSON-1346403232 None] Lock "cinder-5f7fec58-8ccf-4703-9ff1-54f4341a03f3-delete_volume" released by "delete_volume" :: held 2.601s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:15:58 devstack sudo[90342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057.9bbc45f5-09ea-4b26-9f52-8b1eaf4306eb Sep 01 08:15:58 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:15:59 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root Sep 01 08:15:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d028ad62-6db4-4bf2-a0d3-338b8ae268b4 tempest-GroupSnapshotsV319Test-1291919367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057.9bbc45f5-09ea-4b26-9f52-8b1eaf4306eb" returned: 0 in 1.003s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:15:59 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-d028ad62-6db4-4bf2-a0d3-338b8ae268b4 tempest-GroupSnapshotsV319Test-1291919367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:15:59 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dac2a9-140a-405e-8289-287eae3fb1d1]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:15:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d028ad62-6db4-4bf2-a0d3-338b8ae268b4 tempest-GroupSnapshotsV319Test-1291919367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:15:59 devstack sudo[90352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057 Sep 01 08:15:59 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:00 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d028ad62-6db4-4bf2-a0d3-338b8ae268b4 tempest-GroupSnapshotsV319Test-1291919367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057" returned: 0 in 0.809s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d028ad62-6db4-4bf2-a0d3-338b8ae268b4 tempest-GroupSnapshotsV319Test-1291919367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057.9bbc45f5-09ea-4b26-9f52-8b1eaf4306eb {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:00 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057.9bbc45f5-09ea-4b26-9f52-8b1eaf4306eb Sep 01 08:16:00 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d028ad62-6db4-4bf2-a0d3-338b8ae268b4 tempest-GroupSnapshotsV319Test-1291919367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057.9bbc45f5-09ea-4b26-9f52-8b1eaf4306eb" returned: 0 in 0.568s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d028ad62-6db4-4bf2-a0d3-338b8ae268b4 tempest-GroupSnapshotsV319Test-1291919367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057.9bbc45f5-09ea-4b26-9f52-8b1eaf4306eb {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:00 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:00 devstack sudo[90367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057.9bbc45f5-09ea-4b26-9f52-8b1eaf4306eb Sep 01 08:16:00 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:00 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d028ad62-6db4-4bf2-a0d3-338b8ae268b4 tempest-GroupSnapshotsV319Test-1291919367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057.9bbc45f5-09ea-4b26-9f52-8b1eaf4306eb" returned: 0 in 0.352s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:01 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d028ad62-6db4-4bf2-a0d3-338b8ae268b4 tempest-GroupSnapshotsV319Test-1291919367 None] Lock "cinder-quobyte-9bbc45f5-09ea-4b26-9f52-8b1eaf4306eb" released by "_delete_snapshot" :: held 2.941s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:16:01 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d028ad62-6db4-4bf2-a0d3-338b8ae268b4 tempest-GroupSnapshotsV319Test-1291919367 None] Lock "cinder-quobyte-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057" released by "delete_snapshot" :: held 3.026s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:16:01 devstack cinder-volume[86893]: WARNING cinder.quota [None req-d028ad62-6db4-4bf2-a0d3-338b8ae268b4 tempest-GroupSnapshotsV319Test-1291919367 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-230417486 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-230417486, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:16:01 devstack cinder-volume[86893]: WARNING cinder.quota [None req-d028ad62-6db4-4bf2-a0d3-338b8ae268b4 tempest-GroupSnapshotsV319Test-1291919367 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-230417486 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-230417486, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:16:01 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-d028ad62-6db4-4bf2-a0d3-338b8ae268b4 tempest-GroupSnapshotsV319Test-1291919367 None] Created reservations ['585ee47d-1e8b-4e44-81d7-dc17aa7a931d', '67c391de-6641-4fdb-bf54-cf79fa263e1a', '07b7e97f-facb-4113-b0f0-c2345d1bf3d0', 'ee60f1df-2680-4662-90dc-9d7a69729507'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:16:01 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-d028ad62-6db4-4bf2-a0d3-338b8ae268b4 tempest-GroupSnapshotsV319Test-1291919367 None] group_snapshot 51fe37a5-71da-4f1c-a056-4fd89adff42c: deleted successfully Sep 01 08:16:02 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-74db45a1-49bc-4ab4-8614-c835e7ad61f3 tempest-GroupSnapshotsV319Test-1291919367 None] Acquiring lock "cinder-quobyte-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:16:02 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-74db45a1-49bc-4ab4-8614-c835e7ad61f3 tempest-GroupSnapshotsV319Test-1291919367 None] Lock "cinder-quobyte-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057" acquired by "delete_volume" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:16:02 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0f976e-e7dd-45ea-b861-590492275ce6]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:16:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-74db45a1-49bc-4ab4-8614-c835e7ad61f3 tempest-GroupSnapshotsV319Test-1291919367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:02 devstack sudo[90370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057 Sep 01 08:16:02 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:02 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-74db45a1-49bc-4ab4-8614-c835e7ad61f3 tempest-GroupSnapshotsV319Test-1291919367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057" returned: 0 in 0.582s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-74db45a1-49bc-4ab4-8614-c835e7ad61f3 tempest-GroupSnapshotsV319Test-1291919367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:02 devstack sudo[90375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057 Sep 01 08:16:02 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:03 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-74db45a1-49bc-4ab4-8614-c835e7ad61f3 tempest-GroupSnapshotsV319Test-1291919367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057" returned: 0 in 0.355s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:03 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-74db45a1-49bc-4ab4-8614-c835e7ad61f3 tempest-GroupSnapshotsV319Test-1291919367 None] Lock "cinder-quobyte-2c4037ca-ef95-4819-b6ef-f9cf5a3a9057" released by "delete_volume" :: held 1.012s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:16:03 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-74db45a1-49bc-4ab4-8614-c835e7ad61f3 tempest-GroupSnapshotsV319Test-1291919367 None] Created reservations ['0e9b2f30-29cb-4f8c-bc71-392ae7299dab'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:16:03 devstack cinder-volume[86893]: WARNING cinder.quota [None req-74db45a1-49bc-4ab4-8614-c835e7ad61f3 tempest-GroupSnapshotsV319Test-1291919367 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-230417486 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-230417486, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:16:03 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-74db45a1-49bc-4ab4-8614-c835e7ad61f3 tempest-GroupSnapshotsV319Test-1291919367 None] Created reservations ['848fa44c-4241-4248-a357-65cb2f2d6d51', 'ee6e7ef0-6480-4bcc-866d-d78a6d7d4384', 'd5dc15c1-fce7-4bef-82aa-34a841819882', 'fea9fde3-6fe5-4486-889d-0b1ee156bea2'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:16:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-74db45a1-49bc-4ab4-8614-c835e7ad61f3 tempest-GroupSnapshotsV319Test-1291919367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:16:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-74db45a1-49bc-4ab4-8614-c835e7ad61f3 tempest-GroupSnapshotsV319Test-1291919367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:16:03 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-74db45a1-49bc-4ab4-8614-c835e7ad61f3 tempest-GroupSnapshotsV319Test-1291919367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:16:03 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-74db45a1-49bc-4ab4-8614-c835e7ad61f3 tempest-GroupSnapshotsV319Test-1291919367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:16:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-74db45a1-49bc-4ab4-8614-c835e7ad61f3 tempest-GroupSnapshotsV319Test-1291919367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:16:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-74db45a1-49bc-4ab4-8614-c835e7ad61f3 tempest-GroupSnapshotsV319Test-1291919367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:03 devstack sudo[90378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:16:03 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:03 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-74db45a1-49bc-4ab4-8614-c835e7ad61f3 tempest-GroupSnapshotsV319Test-1291919367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.312s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:03 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-74db45a1-49bc-4ab4-8614-c835e7ad61f3 tempest-GroupSnapshotsV319Test-1291919367 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:16:03 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-74db45a1-49bc-4ab4-8614-c835e7ad61f3 tempest-GroupSnapshotsV319Test-1291919367 None] Delete group completed successfully. Sep 01 08:16:13 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:UPDATE=64,cinder:INSERT=24,cinder:SELECT=64,cinder:DELETE=6 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:16:13 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=72,cinder:INSERT=16,cinder:UPDATE=99,cinder:DELETE=5 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:16:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-68adcd53-83c6-4706-8693-4a6400301f04 req-94b38341-5f68-48a1-9e6e-f142cb82afaf tempest-ServerActionsTestOtherA-1037332526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:16:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-68adcd53-83c6-4706-8693-4a6400301f04 req-94b38341-5f68-48a1-9e6e-f142cb82afaf tempest-ServerActionsTestOtherA-1037332526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:16:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-68adcd53-83c6-4706-8693-4a6400301f04 req-94b38341-5f68-48a1-9e6e-f142cb82afaf tempest-ServerActionsTestOtherA-1037332526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:16:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-68adcd53-83c6-4706-8693-4a6400301f04 req-94b38341-5f68-48a1-9e6e-f142cb82afaf tempest-ServerActionsTestOtherA-1037332526 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049', 'name': 'volume-22204264-a063-49c9-b2af-4fdd2ec6ce61', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '06cb4614-f7f3-49e9-a38c-13ce3f5f7c3e', 'enforce_multipath': True} {{(pid=86893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 08:16:21 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-68adcd53-83c6-4706-8693-4a6400301f04 req-94b38341-5f68-48a1-9e6e-f142cb82afaf tempest-ServerActionsTestOtherA-1037332526 None] attachment_update completed successfully. Sep 01 08:16:24 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:16:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] Flow 'volume_create_manager' (30ce9ebe-efb8-4eb3-83fb-9981573b335a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:16:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf7f90a-05d3-4b84-b88f-e550c883259b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf7f90a-05d3-4b84-b88f-e550c883259b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1367787620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4831d84-a946-490c-bc2f-fcd02a1e0162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a74d92f74d344c1a21dfface2f735a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:16:24Z,use_quota=True,user_id='7f87244047e14dada6293f681d8dbc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc50984a-c48d-4922-8352-b8e133fd3c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc50984a-c48d-4922-8352-b8e133fd3c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c48569f7-733e-4763-962e-4acfa3e49bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c48569f7-733e-4763-962e-4acfa3e49bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4831d84-a946-490c-bc2f-fcd02a1e0162', 'volume_name': 'volume-f4831d84-a946-490c-bc2f-fcd02a1e0162', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e02d569e-ac5d-4ff2-ad6c-89c86c5bb69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e02d569e-ac5d-4ff2-ad6c-89c86c5bb69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc04a064-b5c8-4fcd-a130-f1745d4977e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:24 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] Volume f4831d84-a946-490c-bc2f-fcd02a1e0162: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4831d84-a946-490c-bc2f-fcd02a1e0162', 'volume_size': 1} Sep 01 08:16:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:16:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:16:24 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1367787620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4831d84-a946-490c-bc2f-fcd02a1e0162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a74d92f74d344c1a21dfface2f735a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:16:24Z,use_quota=True,user_id='7f87244047e14dada6293f681d8dbc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:16:24 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] Creating volume f4831d84-a946-490c-bc2f-fcd02a1e0162 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:16:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:16:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:16:24 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:16:24 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:16:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:16:24 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:16:24 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:16:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f4831d84-a946-490c-bc2f-fcd02a1e0162 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:24 devstack sudo[90835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f4831d84-a946-490c-bc2f-fcd02a1e0162 1073741824 Sep 01 08:16:24 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:24 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f4831d84-a946-490c-bc2f-fcd02a1e0162 1073741824" returned: 0 in 0.709s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f4831d84-a946-490c-bc2f-fcd02a1e0162 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:25 devstack sudo[90844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f4831d84-a946-490c-bc2f-fcd02a1e0162 Sep 01 08:16:25 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:25 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f4831d84-a946-490c-bc2f-fcd02a1e0162" returned: 0 in 0.386s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:16:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:16:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc04a064-b5c8-4fcd-a130-f1745d4977e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4831d84-a946-490c-bc2f-fcd02a1e0162', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20a3f7c-c9d9-4f00-8871-6648daad3016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:25 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] Volume volume-f4831d84-a946-490c-bc2f-fcd02a1e0162 (f4831d84-a946-490c-bc2f-fcd02a1e0162): created successfully Sep 01 08:16:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20a3f7c-c9d9-4f00-8871-6648daad3016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] Flow 'volume_create_manager' (30ce9ebe-efb8-4eb3-83fb-9981573b335a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:16:25 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-73f55ae4-014f-4935-9a89-ca2f43d0f01e tempest-VolumesListAdminTestJSON-115568014 None] Created volume successfully. Sep 01 08:16:26 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-3e6187b6-18bc-4a30-9158-b6977331a12c req-f21459c8-6be4-4686-a2c1-f076123a52c5 tempest-ServerActionsTestOtherA-1037332526 None] Terminate volume connection completed successfully. Sep 01 08:16:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-3e6187b6-18bc-4a30-9158-b6977331a12c req-f21459c8-6be4-4686-a2c1-f076123a52c5 tempest-ServerActionsTestOtherA-1037332526 None] Deleting attachment 06cb4614-f7f3-49e9-a38c-13ce3f5f7c3e. {{(pid=86893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 08:16:27 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:16:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] Flow 'volume_create_manager' (3b650bdc-e0ed-49b4-9f61-edc39679e7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:16:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2906aba-0db0-4fb5-aa2a-daf25898e214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2906aba-0db0-4fb5-aa2a-daf25898e214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1338741162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c3a3242-5c1c-44a1-8ab6-01022b373a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a74d92f74d344c1a21dfface2f735a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:16:27Z,use_quota=True,user_id='7f87244047e14dada6293f681d8dbc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (952c98f1-6ff3-42d3-8c39-5817d82af0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (952c98f1-6ff3-42d3-8c39-5817d82af0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dbefab0-f971-403a-bc7b-6891ab6071b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dbefab0-f971-403a-bc7b-6891ab6071b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c3a3242-5c1c-44a1-8ab6-01022b373a1f', 'volume_name': 'volume-8c3a3242-5c1c-44a1-8ab6-01022b373a1f', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f9bcc5-9bc9-4543-a6f5-02ba53f30bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f9bcc5-9bc9-4543-a6f5-02ba53f30bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc3d16d9-1f76-484d-a1f4-7c01b0d534e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:27 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] Volume 8c3a3242-5c1c-44a1-8ab6-01022b373a1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c3a3242-5c1c-44a1-8ab6-01022b373a1f', 'volume_size': 1} Sep 01 08:16:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:16:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:16:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1338741162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c3a3242-5c1c-44a1-8ab6-01022b373a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a74d92f74d344c1a21dfface2f735a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:16:27Z,use_quota=True,user_id='7f87244047e14dada6293f681d8dbc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:16:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] Creating volume 8c3a3242-5c1c-44a1-8ab6-01022b373a1f {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:16:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:16:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:16:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:16:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:16:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:16:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:16:27 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:16:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8c3a3242-5c1c-44a1-8ab6-01022b373a1f 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-3e6187b6-18bc-4a30-9158-b6977331a12c req-117bf98b-4af8-4744-a160-ce6460ee04f9 tempest-ServerActionsTestOtherA-1037332526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:16:27 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8c3a3242-5c1c-44a1-8ab6-01022b373a1f 1073741824 Sep 01 08:16:27 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:27 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8c3a3242-5c1c-44a1-8ab6-01022b373a1f 1073741824" returned: 0 in 0.535s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8c3a3242-5c1c-44a1-8ab6-01022b373a1f {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:28 devstack sudo[90929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8c3a3242-5c1c-44a1-8ab6-01022b373a1f Sep 01 08:16:28 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:28 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8c3a3242-5c1c-44a1-8ab6-01022b373a1f" returned: 0 in 0.350s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:16:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:16:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-3e6187b6-18bc-4a30-9158-b6977331a12c req-117bf98b-4af8-4744-a160-ce6460ee04f9 tempest-ServerActionsTestOtherA-1037332526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.899s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:16:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc3d16d9-1f76-484d-a1f4-7c01b0d534e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c3a3242-5c1c-44a1-8ab6-01022b373a1f', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e6c3de-52dd-410e-9971-44775d5b2e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-3e6187b6-18bc-4a30-9158-b6977331a12c req-117bf98b-4af8-4744-a160-ce6460ee04f9 tempest-ServerActionsTestOtherA-1037332526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:16:28 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] Volume volume-8c3a3242-5c1c-44a1-8ab6-01022b373a1f (8c3a3242-5c1c-44a1-8ab6-01022b373a1f): created successfully Sep 01 08:16:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e6c3de-52dd-410e-9971-44775d5b2e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] Flow 'volume_create_manager' (3b650bdc-e0ed-49b4-9f61-edc39679e7e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:16:28 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-0b6dbf12-1e4a-4fac-ab3b-31705a84d1f6 tempest-VolumesListAdminTestJSON-115568014 None] Created volume successfully. Sep 01 08:16:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-3e6187b6-18bc-4a30-9158-b6977331a12c req-117bf98b-4af8-4744-a160-ce6460ee04f9 tempest-ServerActionsTestOtherA-1037332526 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049', 'name': 'volume-22204264-a063-49c9-b2af-4fdd2ec6ce61', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4d298fe9-80a9-42b1-bad9-f31f83e13366', 'enforce_multipath': True} {{(pid=86893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 08:16:28 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-3e6187b6-18bc-4a30-9158-b6977331a12c req-117bf98b-4af8-4744-a160-ce6460ee04f9 tempest-ServerActionsTestOtherA-1037332526 None] attachment_update completed successfully. Sep 01 08:16:30 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:16:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] Flow 'volume_create_manager' (b938130d-d39b-4142-acb9-b78c622598ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:16:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a7777e4-bed5-459b-90cf-4a068e949f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a7777e4-bed5-459b-90cf-4a068e949f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1840286125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc798a7a-bcd8-49ac-9320-c25c18e4e740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a74d92f74d344c1a21dfface2f735a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:16:30Z,use_quota=True,user_id='7f87244047e14dada6293f681d8dbc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f44eb7f-6c10-4568-830a-80e377d85ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f44eb7f-6c10-4568-830a-80e377d85ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b5314b-d05e-48fc-893c-fb070591be4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b5314b-d05e-48fc-893c-fb070591be4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc798a7a-bcd8-49ac-9320-c25c18e4e740', 'volume_name': 'volume-bc798a7a-bcd8-49ac-9320-c25c18e4e740', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af618549-bb15-4213-b718-75edbd7d9ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af618549-bb15-4213-b718-75edbd7d9ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ae44a49-3a99-417d-8378-5c9ff6e0d974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:30 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] Volume bc798a7a-bcd8-49ac-9320-c25c18e4e740: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc798a7a-bcd8-49ac-9320-c25c18e4e740', 'volume_size': 1} Sep 01 08:16:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:16:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:16:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1840286125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc798a7a-bcd8-49ac-9320-c25c18e4e740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a74d92f74d344c1a21dfface2f735a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:16:30Z,use_quota=True,user_id='7f87244047e14dada6293f681d8dbc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:16:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] Creating volume bc798a7a-bcd8-49ac-9320-c25c18e4e740 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:16:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:16:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:16:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:16:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:16:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:16:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:16:30 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:16:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bc798a7a-bcd8-49ac-9320-c25c18e4e740 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:30 devstack sudo[91060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bc798a7a-bcd8-49ac-9320-c25c18e4e740 1073741824 Sep 01 08:16:30 devstack sudo[91060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:16:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:16:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:16:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:16:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:16:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:16:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:31 devstack sudo[91095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:16:31 devstack sudo[91095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:31 devstack sudo[91095]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.587s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:31 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:16:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager._thread_info {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:16:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread count: 8 {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 08:16:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread info: [<_MainThread(MainThread, started 138934582050944)>, , , , , , , ] {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 08:16:31 devstack sudo[91060]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bc798a7a-bcd8-49ac-9320-c25c18e4e740 1073741824" returned: 0 in 1.128s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bc798a7a-bcd8-49ac-9320-c25c18e4e740 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:31 devstack sudo[91441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bc798a7a-bcd8-49ac-9320-c25c18e4e740 Sep 01 08:16:31 devstack sudo[91441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:32 devstack sudo[91441]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bc798a7a-bcd8-49ac-9320-c25c18e4e740" returned: 0 in 0.494s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:32 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:16:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:16:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ae44a49-3a99-417d-8378-5c9ff6e0d974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc798a7a-bcd8-49ac-9320-c25c18e4e740', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8feb8327-6511-4de8-8812-5b6b971ed901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:32 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] Volume volume-bc798a7a-bcd8-49ac-9320-c25c18e4e740 (bc798a7a-bcd8-49ac-9320-c25c18e4e740): created successfully Sep 01 08:16:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8feb8327-6511-4de8-8812-5b6b971ed901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] Flow 'volume_create_manager' (b938130d-d39b-4142-acb9-b78c622598ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:16:32 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-6391de89-1785-46b3-8045-6f467047a3db tempest-VolumesListAdminTestJSON-115568014 None] Created volume successfully. Sep 01 08:16:34 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:16:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] Flow 'volume_create_manager' (5453f3cc-64b7-40a7-a338-a8e49cbe62ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:16:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9609bc93-f7dc-42a0-b572-d9ef568be255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9609bc93-f7dc-42a0-b572-d9ef568be255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c786c6-1aae-45bc-981d-c2eca0a2f719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cc1429314164a499801b67f2cc095e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:16:35Z,use_quota=True,user_id='047d77de619d4ef4a6f7fa00000f4596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1981a1a-0ad4-4948-871d-39a6939dff9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1981a1a-0ad4-4948-871d-39a6939dff9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c08bdf6-5957-45df-9c7f-b2890d9fca84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c08bdf6-5957-45df-9c7f-b2890d9fca84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0c786c6-1aae-45bc-981d-c2eca0a2f719', 'volume_name': 'volume-d0c786c6-1aae-45bc-981d-c2eca0a2f719', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1307ceaf-ff59-4b53-810a-65437705c8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1307ceaf-ff59-4b53-810a-65437705c8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea6846f-d97e-4249-868d-ebdbebb057e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:34 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] Volume d0c786c6-1aae-45bc-981d-c2eca0a2f719: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0c786c6-1aae-45bc-981d-c2eca0a2f719', 'volume_size': 1} Sep 01 08:16:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:16:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:16:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c786c6-1aae-45bc-981d-c2eca0a2f719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cc1429314164a499801b67f2cc095e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:16:35Z,use_quota=True,user_id='047d77de619d4ef4a6f7fa00000f4596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:16:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] Creating volume d0c786c6-1aae-45bc-981d-c2eca0a2f719 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:16:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:16:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:16:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:16:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:16:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:16:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:16:34 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:16:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d0c786c6-1aae-45bc-981d-c2eca0a2f719 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:34 devstack sudo[91450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d0c786c6-1aae-45bc-981d-c2eca0a2f719 1073741824 Sep 01 08:16:34 devstack sudo[91450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:35 devstack sudo[91450]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d0c786c6-1aae-45bc-981d-c2eca0a2f719 1073741824" returned: 0 in 0.722s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d0c786c6-1aae-45bc-981d-c2eca0a2f719 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:35 devstack sudo[91456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d0c786c6-1aae-45bc-981d-c2eca0a2f719 Sep 01 08:16:35 devstack sudo[91456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:36 devstack sudo[91456]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d0c786c6-1aae-45bc-981d-c2eca0a2f719" returned: 0 in 0.533s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:16:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:16:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea6846f-d97e-4249-868d-ebdbebb057e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0c786c6-1aae-45bc-981d-c2eca0a2f719', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e23edc-925c-4048-86f3-625fe1e4f769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:36 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] Volume volume-d0c786c6-1aae-45bc-981d-c2eca0a2f719 (d0c786c6-1aae-45bc-981d-c2eca0a2f719): created successfully Sep 01 08:16:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e23edc-925c-4048-86f3-625fe1e4f769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] Flow 'volume_create_manager' (5453f3cc-64b7-40a7-a338-a8e49cbe62ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:16:36 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-4122e989-739d-4631-ac88-6c6accea9589 tempest-VolumesListAdminTestJSON-1441018514 None] Created volume successfully. Sep 01 08:16:36 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-75c4c8f4-3460-4f0e-adc0-c8aece5930d3 tempest-VolumesListAdminTestJSON-1441018514 None] Acquiring lock "cinder-d0c786c6-1aae-45bc-981d-c2eca0a2f719-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:16:36 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-75c4c8f4-3460-4f0e-adc0-c8aece5930d3 tempest-VolumesListAdminTestJSON-1441018514 None] Lock "cinder-d0c786c6-1aae-45bc-981d-c2eca0a2f719-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:16:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-75c4c8f4-3460-4f0e-adc0-c8aece5930d3 tempest-VolumesListAdminTestJSON-1441018514 None] Acquiring lock "cinder-quobyte-d0c786c6-1aae-45bc-981d-c2eca0a2f719" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:16:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-75c4c8f4-3460-4f0e-adc0-c8aece5930d3 tempest-VolumesListAdminTestJSON-1441018514 None] Lock "cinder-quobyte-d0c786c6-1aae-45bc-981d-c2eca0a2f719" acquired by "delete_volume" :: waited 0.035s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:16:37 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4e09e3-bbeb-40f3-9fc7-a3227019de95]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:16:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-75c4c8f4-3460-4f0e-adc0-c8aece5930d3 tempest-VolumesListAdminTestJSON-1441018514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d0c786c6-1aae-45bc-981d-c2eca0a2f719 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-78d51728-672f-4924-b5b5-aaa56b01e578 tempest-VolumesListAdminTestJSON-115568014 None] Acquiring lock "cinder-bc798a7a-bcd8-49ac-9320-c25c18e4e740-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:16:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-78d51728-672f-4924-b5b5-aaa56b01e578 tempest-VolumesListAdminTestJSON-115568014 None] Lock "cinder-bc798a7a-bcd8-49ac-9320-c25c18e4e740-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:16:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-78d51728-672f-4924-b5b5-aaa56b01e578 tempest-VolumesListAdminTestJSON-115568014 None] Acquiring lock "cinder-quobyte-bc798a7a-bcd8-49ac-9320-c25c18e4e740" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:16:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-78d51728-672f-4924-b5b5-aaa56b01e578 tempest-VolumesListAdminTestJSON-115568014 None] Lock "cinder-quobyte-bc798a7a-bcd8-49ac-9320-c25c18e4e740" acquired by "delete_volume" :: waited 0.075s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:16:37 devstack sudo[91463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d0c786c6-1aae-45bc-981d-c2eca0a2f719 Sep 01 08:16:37 devstack sudo[91463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:37 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7e3d80-438e-4504-afd0-4dd35dcea5bd]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:16:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-78d51728-672f-4924-b5b5-aaa56b01e578 tempest-VolumesListAdminTestJSON-115568014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bc798a7a-bcd8-49ac-9320-c25c18e4e740 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:37 devstack sudo[91465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bc798a7a-bcd8-49ac-9320-c25c18e4e740 Sep 01 08:16:37 devstack sudo[91465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:37 devstack sudo[91463]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-75c4c8f4-3460-4f0e-adc0-c8aece5930d3 tempest-VolumesListAdminTestJSON-1441018514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d0c786c6-1aae-45bc-981d-c2eca0a2f719" returned: 0 in 0.706s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-75c4c8f4-3460-4f0e-adc0-c8aece5930d3 tempest-VolumesListAdminTestJSON-1441018514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d0c786c6-1aae-45bc-981d-c2eca0a2f719 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:37 devstack sudo[91471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d0c786c6-1aae-45bc-981d-c2eca0a2f719 Sep 01 08:16:37 devstack sudo[91471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:38 devstack sudo[91465]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-78d51728-672f-4924-b5b5-aaa56b01e578 tempest-VolumesListAdminTestJSON-115568014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bc798a7a-bcd8-49ac-9320-c25c18e4e740" returned: 0 in 0.775s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-78d51728-672f-4924-b5b5-aaa56b01e578 tempest-VolumesListAdminTestJSON-115568014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bc798a7a-bcd8-49ac-9320-c25c18e4e740 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:38 devstack sudo[91477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bc798a7a-bcd8-49ac-9320-c25c18e4e740 Sep 01 08:16:38 devstack sudo[91477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:38 devstack sudo[91471]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-75c4c8f4-3460-4f0e-adc0-c8aece5930d3 tempest-VolumesListAdminTestJSON-1441018514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d0c786c6-1aae-45bc-981d-c2eca0a2f719" returned: 0 in 0.518s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:38 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-75c4c8f4-3460-4f0e-adc0-c8aece5930d3 tempest-VolumesListAdminTestJSON-1441018514 None] Lock "cinder-quobyte-d0c786c6-1aae-45bc-981d-c2eca0a2f719" released by "delete_volume" :: held 1.289s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:16:38 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-75c4c8f4-3460-4f0e-adc0-c8aece5930d3 tempest-VolumesListAdminTestJSON-1441018514 None] Created reservations ['dd3dcb0e-eb61-4879-8fee-b42da2a8d2bd', '054b1aaa-f07b-4b0a-ab81-629692a36e16', 'b47d3664-f2fb-4446-8d7c-3a5e67f99cf1', '540179df-a806-4159-8c98-7020ac256ba5'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:16:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-75c4c8f4-3460-4f0e-adc0-c8aece5930d3 tempest-VolumesListAdminTestJSON-1441018514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:16:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-75c4c8f4-3460-4f0e-adc0-c8aece5930d3 tempest-VolumesListAdminTestJSON-1441018514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:16:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-75c4c8f4-3460-4f0e-adc0-c8aece5930d3 tempest-VolumesListAdminTestJSON-1441018514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:16:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-75c4c8f4-3460-4f0e-adc0-c8aece5930d3 tempest-VolumesListAdminTestJSON-1441018514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:16:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-75c4c8f4-3460-4f0e-adc0-c8aece5930d3 tempest-VolumesListAdminTestJSON-1441018514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:16:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-75c4c8f4-3460-4f0e-adc0-c8aece5930d3 tempest-VolumesListAdminTestJSON-1441018514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:38 devstack sudo[91479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:16:38 devstack sudo[91479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:38 devstack sudo[91477]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-78d51728-672f-4924-b5b5-aaa56b01e578 tempest-VolumesListAdminTestJSON-115568014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bc798a7a-bcd8-49ac-9320-c25c18e4e740" returned: 0 in 0.563s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:38 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-78d51728-672f-4924-b5b5-aaa56b01e578 tempest-VolumesListAdminTestJSON-115568014 None] Lock "cinder-quobyte-bc798a7a-bcd8-49ac-9320-c25c18e4e740" released by "delete_volume" :: held 1.450s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:16:38 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-78d51728-672f-4924-b5b5-aaa56b01e578 tempest-VolumesListAdminTestJSON-115568014 None] Created reservations ['45e2c877-c5f5-4db1-9e3a-a0ef1475ac2f', '461c4b5e-1826-453d-b37e-b11913c9a822', 'f8d6ba88-e01c-4afe-8815-ff1d825bf54d', 'd8e4216b-8b66-4d84-9b6b-965900e010f2'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:16:38 devstack sudo[91479]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-75c4c8f4-3460-4f0e-adc0-c8aece5930d3 tempest-VolumesListAdminTestJSON-1441018514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.373s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:38 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-75c4c8f4-3460-4f0e-adc0-c8aece5930d3 tempest-VolumesListAdminTestJSON-1441018514 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:16:38 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-75c4c8f4-3460-4f0e-adc0-c8aece5930d3 tempest-VolumesListAdminTestJSON-1441018514 None] Deleted volume successfully. Sep 01 08:16:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-75c4c8f4-3460-4f0e-adc0-c8aece5930d3 tempest-VolumesListAdminTestJSON-1441018514 None] Lock "cinder-d0c786c6-1aae-45bc-981d-c2eca0a2f719-delete_volume" released by "delete_volume" :: held 2.062s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:16:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-78d51728-672f-4924-b5b5-aaa56b01e578 tempest-VolumesListAdminTestJSON-115568014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:16:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-78d51728-672f-4924-b5b5-aaa56b01e578 tempest-VolumesListAdminTestJSON-115568014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:16:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-78d51728-672f-4924-b5b5-aaa56b01e578 tempest-VolumesListAdminTestJSON-115568014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:16:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-78d51728-672f-4924-b5b5-aaa56b01e578 tempest-VolumesListAdminTestJSON-115568014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:16:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-78d51728-672f-4924-b5b5-aaa56b01e578 tempest-VolumesListAdminTestJSON-115568014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:16:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-78d51728-672f-4924-b5b5-aaa56b01e578 tempest-VolumesListAdminTestJSON-115568014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:39 devstack sudo[91483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:16:39 devstack sudo[91483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:39 devstack sudo[91483]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-78d51728-672f-4924-b5b5-aaa56b01e578 tempest-VolumesListAdminTestJSON-115568014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.301s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:39 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-78d51728-672f-4924-b5b5-aaa56b01e578 tempest-VolumesListAdminTestJSON-115568014 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:16:39 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-78d51728-672f-4924-b5b5-aaa56b01e578 tempest-VolumesListAdminTestJSON-115568014 None] Deleted volume successfully. Sep 01 08:16:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-78d51728-672f-4924-b5b5-aaa56b01e578 tempest-VolumesListAdminTestJSON-115568014 None] Lock "cinder-bc798a7a-bcd8-49ac-9320-c25c18e4e740-delete_volume" released by "delete_volume" :: held 2.170s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:16:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8f8d4895-d92a-4a6e-95bf-e23999f91c39 tempest-VolumesListAdminTestJSON-115568014 None] Acquiring lock "cinder-8c3a3242-5c1c-44a1-8ab6-01022b373a1f-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:16:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8f8d4895-d92a-4a6e-95bf-e23999f91c39 tempest-VolumesListAdminTestJSON-115568014 None] Lock "cinder-8c3a3242-5c1c-44a1-8ab6-01022b373a1f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:16:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8f8d4895-d92a-4a6e-95bf-e23999f91c39 tempest-VolumesListAdminTestJSON-115568014 None] Acquiring lock "cinder-quobyte-8c3a3242-5c1c-44a1-8ab6-01022b373a1f" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:16:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8f8d4895-d92a-4a6e-95bf-e23999f91c39 tempest-VolumesListAdminTestJSON-115568014 None] Lock "cinder-quobyte-8c3a3242-5c1c-44a1-8ab6-01022b373a1f" acquired by "delete_volume" :: waited 0.032s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:16:39 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a2b0a6-1502-4296-95ef-5272e3b39be4]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:16:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8f8d4895-d92a-4a6e-95bf-e23999f91c39 tempest-VolumesListAdminTestJSON-115568014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8c3a3242-5c1c-44a1-8ab6-01022b373a1f {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:40 devstack sudo[91487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8c3a3242-5c1c-44a1-8ab6-01022b373a1f Sep 01 08:16:40 devstack sudo[91487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:40 devstack sudo[91487]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8f8d4895-d92a-4a6e-95bf-e23999f91c39 tempest-VolumesListAdminTestJSON-115568014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8c3a3242-5c1c-44a1-8ab6-01022b373a1f" returned: 0 in 0.452s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8f8d4895-d92a-4a6e-95bf-e23999f91c39 tempest-VolumesListAdminTestJSON-115568014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8c3a3242-5c1c-44a1-8ab6-01022b373a1f {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:40 devstack sudo[91492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8c3a3242-5c1c-44a1-8ab6-01022b373a1f Sep 01 08:16:40 devstack sudo[91492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:40 devstack sudo[91492]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8f8d4895-d92a-4a6e-95bf-e23999f91c39 tempest-VolumesListAdminTestJSON-115568014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8c3a3242-5c1c-44a1-8ab6-01022b373a1f" returned: 0 in 0.320s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8f8d4895-d92a-4a6e-95bf-e23999f91c39 tempest-VolumesListAdminTestJSON-115568014 None] Lock "cinder-quobyte-8c3a3242-5c1c-44a1-8ab6-01022b373a1f" released by "delete_volume" :: held 0.824s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:16:40 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-8f8d4895-d92a-4a6e-95bf-e23999f91c39 tempest-VolumesListAdminTestJSON-115568014 None] Created reservations ['4fa3e01f-0c6f-407c-82d3-6e8216a692ab', '41fef3a3-4faa-4aad-b46b-5cefbdb5d5d4', '99a866e6-6e5d-44d3-824e-ab6c490f4e41', '38e599fe-d4d3-4736-a73d-173f7cf21128'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:16:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8f8d4895-d92a-4a6e-95bf-e23999f91c39 tempest-VolumesListAdminTestJSON-115568014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:16:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8f8d4895-d92a-4a6e-95bf-e23999f91c39 tempest-VolumesListAdminTestJSON-115568014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:16:41 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8f8d4895-d92a-4a6e-95bf-e23999f91c39 tempest-VolumesListAdminTestJSON-115568014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:16:41 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8f8d4895-d92a-4a6e-95bf-e23999f91c39 tempest-VolumesListAdminTestJSON-115568014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:16:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8f8d4895-d92a-4a6e-95bf-e23999f91c39 tempest-VolumesListAdminTestJSON-115568014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:16:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8f8d4895-d92a-4a6e-95bf-e23999f91c39 tempest-VolumesListAdminTestJSON-115568014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:41 devstack sudo[91495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:16:41 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:41 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-16545c99-6c39-4cf6-abf1-6e7f3c455269 tempest-VolumesListAdminTestJSON-115568014 None] Acquiring lock "cinder-f4831d84-a946-490c-bc2f-fcd02a1e0162-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:16:41 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-16545c99-6c39-4cf6-abf1-6e7f3c455269 tempest-VolumesListAdminTestJSON-115568014 None] Lock "cinder-f4831d84-a946-490c-bc2f-fcd02a1e0162-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:16:41 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-16545c99-6c39-4cf6-abf1-6e7f3c455269 tempest-VolumesListAdminTestJSON-115568014 None] Acquiring lock "cinder-quobyte-f4831d84-a946-490c-bc2f-fcd02a1e0162" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:16:41 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-16545c99-6c39-4cf6-abf1-6e7f3c455269 tempest-VolumesListAdminTestJSON-115568014 None] Lock "cinder-quobyte-f4831d84-a946-490c-bc2f-fcd02a1e0162" acquired by "delete_volume" :: waited 0.036s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:16:41 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8f8d4895-d92a-4a6e-95bf-e23999f91c39 tempest-VolumesListAdminTestJSON-115568014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.422s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:41 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-8f8d4895-d92a-4a6e-95bf-e23999f91c39 tempest-VolumesListAdminTestJSON-115568014 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:16:41 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-8f8d4895-d92a-4a6e-95bf-e23999f91c39 tempest-VolumesListAdminTestJSON-115568014 None] Deleted volume successfully. Sep 01 08:16:41 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[8148b082-cc7f-4cef-a112-ac78b1603df6]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:16:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-16545c99-6c39-4cf6-abf1-6e7f3c455269 tempest-VolumesListAdminTestJSON-115568014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f4831d84-a946-490c-bc2f-fcd02a1e0162 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:41 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8f8d4895-d92a-4a6e-95bf-e23999f91c39 tempest-VolumesListAdminTestJSON-115568014 None] Lock "cinder-8c3a3242-5c1c-44a1-8ab6-01022b373a1f-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:16:41 devstack sudo[91498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f4831d84-a946-490c-bc2f-fcd02a1e0162 Sep 01 08:16:41 devstack sudo[91498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:41 devstack sudo[91498]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-16545c99-6c39-4cf6-abf1-6e7f3c455269 tempest-VolumesListAdminTestJSON-115568014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f4831d84-a946-490c-bc2f-fcd02a1e0162" returned: 0 in 0.461s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-16545c99-6c39-4cf6-abf1-6e7f3c455269 tempest-VolumesListAdminTestJSON-115568014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f4831d84-a946-490c-bc2f-fcd02a1e0162 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:41 devstack sudo[91503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f4831d84-a946-490c-bc2f-fcd02a1e0162 Sep 01 08:16:41 devstack sudo[91503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:42 devstack sudo[91503]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-16545c99-6c39-4cf6-abf1-6e7f3c455269 tempest-VolumesListAdminTestJSON-115568014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f4831d84-a946-490c-bc2f-fcd02a1e0162" returned: 0 in 0.329s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-16545c99-6c39-4cf6-abf1-6e7f3c455269 tempest-VolumesListAdminTestJSON-115568014 None] Lock "cinder-quobyte-f4831d84-a946-490c-bc2f-fcd02a1e0162" released by "delete_volume" :: held 0.884s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:16:42 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-16545c99-6c39-4cf6-abf1-6e7f3c455269 tempest-VolumesListAdminTestJSON-115568014 None] Created reservations ['98970667-ff31-4599-8e89-7047f303c224', 'd566e9d8-7371-4a16-b522-d8c512fed8f9', 'e8846e81-a919-48cc-8090-731d8d9c9991', '8a8bbf04-22a2-4559-a8c3-b6e31ed26d20'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:16:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-16545c99-6c39-4cf6-abf1-6e7f3c455269 tempest-VolumesListAdminTestJSON-115568014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:16:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-16545c99-6c39-4cf6-abf1-6e7f3c455269 tempest-VolumesListAdminTestJSON-115568014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:16:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-16545c99-6c39-4cf6-abf1-6e7f3c455269 tempest-VolumesListAdminTestJSON-115568014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:16:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-16545c99-6c39-4cf6-abf1-6e7f3c455269 tempest-VolumesListAdminTestJSON-115568014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:16:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-16545c99-6c39-4cf6-abf1-6e7f3c455269 tempest-VolumesListAdminTestJSON-115568014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:16:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-16545c99-6c39-4cf6-abf1-6e7f3c455269 tempest-VolumesListAdminTestJSON-115568014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:42 devstack sudo[91506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:16:42 devstack sudo[91506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:42 devstack sudo[91506]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-16545c99-6c39-4cf6-abf1-6e7f3c455269 tempest-VolumesListAdminTestJSON-115568014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.387s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:42 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-16545c99-6c39-4cf6-abf1-6e7f3c455269 tempest-VolumesListAdminTestJSON-115568014 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:16:42 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-16545c99-6c39-4cf6-abf1-6e7f3c455269 tempest-VolumesListAdminTestJSON-115568014 None] Deleted volume successfully. Sep 01 08:16:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-16545c99-6c39-4cf6-abf1-6e7f3c455269 tempest-VolumesListAdminTestJSON-115568014 None] Lock "cinder-f4831d84-a946-490c-bc2f-fcd02a1e0162-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:16:50 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:16:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] Flow 'volume_create_manager' (a444edc6-2b1b-4dcd-9369-881da296c50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:16:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12511914-94d9-462c-88eb-18e7ed8310e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12511914-94d9-462c-88eb-18e7ed8310e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-716017101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5570d8f-7f48-443b-b2eb-4845c679b14b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbf10aeb0a324e1a828d1ee1d8611872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:16:50Z,use_quota=True,user_id='15eb6ac21b104a0a8e7c41a087ecd646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cabbd174-5d73-4b0e-8b26-40b91db0a4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cabbd174-5d73-4b0e-8b26-40b91db0a4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2707d29e-04f4-422e-ac1c-d18950749cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2707d29e-04f4-422e-ac1c-d18950749cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5570d8f-7f48-443b-b2eb-4845c679b14b', 'volume_name': 'volume-b5570d8f-7f48-443b-b2eb-4845c679b14b', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f680fee1-efb6-475c-ab8a-1553e9af730c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f680fee1-efb6-475c-ab8a-1553e9af730c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adbef96c-af12-4459-a652-cbc1b0d09b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:50 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] Volume b5570d8f-7f48-443b-b2eb-4845c679b14b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5570d8f-7f48-443b-b2eb-4845c679b14b', 'volume_size': 1} Sep 01 08:16:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:16:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:16:50 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-716017101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5570d8f-7f48-443b-b2eb-4845c679b14b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbf10aeb0a324e1a828d1ee1d8611872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:16:50Z,use_quota=True,user_id='15eb6ac21b104a0a8e7c41a087ecd646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:16:50 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] Creating volume b5570d8f-7f48-443b-b2eb-4845c679b14b {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:16:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:16:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:16:50 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:16:50 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:16:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:16:50 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:16:50 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:16:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b5570d8f-7f48-443b-b2eb-4845c679b14b 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:50 devstack sudo[91575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b5570d8f-7f48-443b-b2eb-4845c679b14b 1073741824 Sep 01 08:16:50 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:50 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b5570d8f-7f48-443b-b2eb-4845c679b14b 1073741824" returned: 0 in 0.409s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b5570d8f-7f48-443b-b2eb-4845c679b14b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:50 devstack sudo[91605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b5570d8f-7f48-443b-b2eb-4845c679b14b Sep 01 08:16:50 devstack sudo[91605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:51 devstack sudo[91605]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b5570d8f-7f48-443b-b2eb-4845c679b14b" returned: 0 in 0.258s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:51 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:16:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:16:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adbef96c-af12-4459-a652-cbc1b0d09b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5570d8f-7f48-443b-b2eb-4845c679b14b', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b07f70c-988f-4701-82db-b9898566ce4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:51 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] Volume volume-b5570d8f-7f48-443b-b2eb-4845c679b14b (b5570d8f-7f48-443b-b2eb-4845c679b14b): created successfully Sep 01 08:16:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b07f70c-988f-4701-82db-b9898566ce4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] Flow 'volume_create_manager' (a444edc6-2b1b-4dcd-9369-881da296c50d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:16:51 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-b8404cd0-b911-4797-9157-f98aad45142c tempest-VolumesTransfersV355Test-1132404614 None] Created volume successfully. Sep 01 08:16:51 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:16:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] Flow 'volume_create_manager' (5deb63ba-de3a-4848-8877-f7ed83aa187a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:16:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145be34e-328d-47d2-b596-aae1d60c5e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145be34e-328d-47d2-b596-aae1d60c5e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1029877995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96cca0a0-719a-46df-8494-7f3d1f4b041f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bda607e38234e6d914a51cb1d48b586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:16:52Z,use_quota=True,user_id='b9fb08969e704fc18e9f5b2dc90650ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07106586-d6f0-49e9-af43-6ce6bf06bda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07106586-d6f0-49e9-af43-6ce6bf06bda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e9cecf5-c4b3-42f0-bed7-863dff49ff29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e9cecf5-c4b3-42f0-bed7-863dff49ff29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96cca0a0-719a-46df-8494-7f3d1f4b041f', 'volume_name': 'volume-96cca0a0-719a-46df-8494-7f3d1f4b041f', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5333c883-e870-451c-9461-33baecdbbaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5333c883-e870-451c-9461-33baecdbbaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e7ae25-29b5-42ef-aafc-b9f0912b10c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:51 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] Volume 96cca0a0-719a-46df-8494-7f3d1f4b041f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96cca0a0-719a-46df-8494-7f3d1f4b041f', 'volume_size': 1} Sep 01 08:16:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:16:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:16:51 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1029877995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96cca0a0-719a-46df-8494-7f3d1f4b041f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bda607e38234e6d914a51cb1d48b586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:16:52Z,use_quota=True,user_id='b9fb08969e704fc18e9f5b2dc90650ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:16:51 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] Creating volume 96cca0a0-719a-46df-8494-7f3d1f4b041f {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:16:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:16:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:16:51 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:16:51 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:16:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:16:51 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:16:51 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:16:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-96cca0a0-719a-46df-8494-7f3d1f4b041f 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:51 devstack sudo[91608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-96cca0a0-719a-46df-8494-7f3d1f4b041f 1073741824 Sep 01 08:16:51 devstack sudo[91608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:52 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-4b2f0f42-7a03-4b79-acda-5799bf0d19e4 tempest-VolumesTransfersV355Test-1086616046 None] Transfer volume completed successfully. Sep 01 08:16:52 devstack sudo[91608]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-96cca0a0-719a-46df-8494-7f3d1f4b041f 1073741824" returned: 0 in 0.434s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-96cca0a0-719a-46df-8494-7f3d1f4b041f {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:52 devstack sudo[91614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-96cca0a0-719a-46df-8494-7f3d1f4b041f Sep 01 08:16:52 devstack sudo[91614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:52 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-27ac5271-5ce2-462a-a1a3-076f1b17adb0 tempest-VolumesTransfersV355Test-313779434 None] Acquiring lock "cinder-b5570d8f-7f48-443b-b2eb-4845c679b14b-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:16:52 devstack sudo[91614]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-96cca0a0-719a-46df-8494-7f3d1f4b041f" returned: 0 in 0.260s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:16:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:16:52 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-27ac5271-5ce2-462a-a1a3-076f1b17adb0 tempest-VolumesTransfersV355Test-313779434 None] Lock "cinder-b5570d8f-7f48-443b-b2eb-4845c679b14b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:16:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e7ae25-29b5-42ef-aafc-b9f0912b10c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96cca0a0-719a-46df-8494-7f3d1f4b041f', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f26737-553c-4094-bc96-957a776ffa37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:52 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] Volume volume-96cca0a0-719a-46df-8494-7f3d1f4b041f (96cca0a0-719a-46df-8494-7f3d1f4b041f): created successfully Sep 01 08:16:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f26737-553c-4094-bc96-957a776ffa37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] Flow 'volume_create_manager' (5deb63ba-de3a-4848-8877-f7ed83aa187a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:16:52 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-230d8033-216b-4438-9689-d26219d462e8 tempest-VolumesServicesTestJSON-1276274017 None] Created volume successfully. Sep 01 08:16:52 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-27ac5271-5ce2-462a-a1a3-076f1b17adb0 tempest-VolumesTransfersV355Test-313779434 None] Acquiring lock "cinder-quobyte-b5570d8f-7f48-443b-b2eb-4845c679b14b" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:16:52 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-27ac5271-5ce2-462a-a1a3-076f1b17adb0 tempest-VolumesTransfersV355Test-313779434 None] Lock "cinder-quobyte-b5570d8f-7f48-443b-b2eb-4845c679b14b" acquired by "delete_volume" :: waited 0.018s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:16:52 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6efb70-0a4d-4072-a70b-158efa20094f]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:16:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27ac5271-5ce2-462a-a1a3-076f1b17adb0 tempest-VolumesTransfersV355Test-313779434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b5570d8f-7f48-443b-b2eb-4845c679b14b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:52 devstack sudo[91617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b5570d8f-7f48-443b-b2eb-4845c679b14b Sep 01 08:16:52 devstack sudo[91617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:52 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f53729fb-3eb8-4fd3-910c-068f845ffe45 tempest-VolumesServicesTestJSON-1276274017 None] Acquiring lock "cinder-96cca0a0-719a-46df-8494-7f3d1f4b041f-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:16:52 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f53729fb-3eb8-4fd3-910c-068f845ffe45 tempest-VolumesServicesTestJSON-1276274017 None] Lock "cinder-96cca0a0-719a-46df-8494-7f3d1f4b041f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:16:53 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f53729fb-3eb8-4fd3-910c-068f845ffe45 tempest-VolumesServicesTestJSON-1276274017 None] Acquiring lock "cinder-quobyte-96cca0a0-719a-46df-8494-7f3d1f4b041f" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:16:53 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f53729fb-3eb8-4fd3-910c-068f845ffe45 tempest-VolumesServicesTestJSON-1276274017 None] Lock "cinder-quobyte-96cca0a0-719a-46df-8494-7f3d1f4b041f" acquired by "delete_volume" :: waited 0.018s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:16:53 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e76bc82-27f4-4fc4-81cb-037233c4d640]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:16:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f53729fb-3eb8-4fd3-910c-068f845ffe45 tempest-VolumesServicesTestJSON-1276274017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-96cca0a0-719a-46df-8494-7f3d1f4b041f {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:53 devstack sudo[91617]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27ac5271-5ce2-462a-a1a3-076f1b17adb0 tempest-VolumesTransfersV355Test-313779434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b5570d8f-7f48-443b-b2eb-4845c679b14b" returned: 0 in 0.373s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27ac5271-5ce2-462a-a1a3-076f1b17adb0 tempest-VolumesTransfersV355Test-313779434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b5570d8f-7f48-443b-b2eb-4845c679b14b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:53 devstack sudo[91623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b5570d8f-7f48-443b-b2eb-4845c679b14b Sep 01 08:16:53 devstack sudo[91623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:53 devstack sudo[91621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-96cca0a0-719a-46df-8494-7f3d1f4b041f Sep 01 08:16:53 devstack sudo[91621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:53 devstack sudo[91623]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27ac5271-5ce2-462a-a1a3-076f1b17adb0 tempest-VolumesTransfersV355Test-313779434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b5570d8f-7f48-443b-b2eb-4845c679b14b" returned: 0 in 0.236s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:53 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-27ac5271-5ce2-462a-a1a3-076f1b17adb0 tempest-VolumesTransfersV355Test-313779434 None] Lock "cinder-quobyte-b5570d8f-7f48-443b-b2eb-4845c679b14b" released by "delete_volume" :: held 0.659s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:16:53 devstack sudo[91621]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f53729fb-3eb8-4fd3-910c-068f845ffe45 tempest-VolumesServicesTestJSON-1276274017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-96cca0a0-719a-46df-8494-7f3d1f4b041f" returned: 0 in 0.364s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f53729fb-3eb8-4fd3-910c-068f845ffe45 tempest-VolumesServicesTestJSON-1276274017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-96cca0a0-719a-46df-8494-7f3d1f4b041f {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:53 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-27ac5271-5ce2-462a-a1a3-076f1b17adb0 tempest-VolumesTransfersV355Test-313779434 None] Created reservations ['214a90a3-ea08-40b0-b867-12b6cf157e4d', 'fc98f682-7d01-4b44-bba2-5f096451758a', '60e1e445-7a4c-45f8-a322-ebe9d31376cf', '2c247d53-65ba-42d3-9c5e-024c1929e3d4'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:16:53 devstack sudo[91630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-96cca0a0-719a-46df-8494-7f3d1f4b041f Sep 01 08:16:53 devstack sudo[91630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-27ac5271-5ce2-462a-a1a3-076f1b17adb0 tempest-VolumesTransfersV355Test-313779434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:16:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-27ac5271-5ce2-462a-a1a3-076f1b17adb0 tempest-VolumesTransfersV355Test-313779434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:16:53 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-27ac5271-5ce2-462a-a1a3-076f1b17adb0 tempest-VolumesTransfersV355Test-313779434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:16:53 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-27ac5271-5ce2-462a-a1a3-076f1b17adb0 tempest-VolumesTransfersV355Test-313779434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:16:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-27ac5271-5ce2-462a-a1a3-076f1b17adb0 tempest-VolumesTransfersV355Test-313779434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:16:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27ac5271-5ce2-462a-a1a3-076f1b17adb0 tempest-VolumesTransfersV355Test-313779434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:53 devstack sudo[91632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:16:53 devstack sudo[91632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:53 devstack sudo[91630]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f53729fb-3eb8-4fd3-910c-068f845ffe45 tempest-VolumesServicesTestJSON-1276274017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-96cca0a0-719a-46df-8494-7f3d1f4b041f" returned: 0 in 0.304s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:53 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f53729fb-3eb8-4fd3-910c-068f845ffe45 tempest-VolumesServicesTestJSON-1276274017 None] Lock "cinder-quobyte-96cca0a0-719a-46df-8494-7f3d1f4b041f" released by "delete_volume" :: held 0.715s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:16:53 devstack sudo[91632]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27ac5271-5ce2-462a-a1a3-076f1b17adb0 tempest-VolumesTransfersV355Test-313779434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.261s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:53 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-27ac5271-5ce2-462a-a1a3-076f1b17adb0 tempest-VolumesTransfersV355Test-313779434 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:16:53 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-27ac5271-5ce2-462a-a1a3-076f1b17adb0 tempest-VolumesTransfersV355Test-313779434 None] Deleted volume successfully. Sep 01 08:16:53 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-f53729fb-3eb8-4fd3-910c-068f845ffe45 tempest-VolumesServicesTestJSON-1276274017 None] Created reservations ['2df894d1-0679-4329-9007-dc456ca8b6c9', '8b11a7f0-91ce-41ba-b8e4-46d8633af227', 'c583d435-be8a-4012-bac1-38087431867b', '045678ad-b9e1-47e1-bc4e-5fec4a62aa30'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:16:53 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-27ac5271-5ce2-462a-a1a3-076f1b17adb0 tempest-VolumesTransfersV355Test-313779434 None] Lock "cinder-b5570d8f-7f48-443b-b2eb-4845c679b14b-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:16:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f53729fb-3eb8-4fd3-910c-068f845ffe45 tempest-VolumesServicesTestJSON-1276274017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:16:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f53729fb-3eb8-4fd3-910c-068f845ffe45 tempest-VolumesServicesTestJSON-1276274017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:16:53 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f53729fb-3eb8-4fd3-910c-068f845ffe45 tempest-VolumesServicesTestJSON-1276274017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:16:53 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f53729fb-3eb8-4fd3-910c-068f845ffe45 tempest-VolumesServicesTestJSON-1276274017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:16:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f53729fb-3eb8-4fd3-910c-068f845ffe45 tempest-VolumesServicesTestJSON-1276274017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:16:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f53729fb-3eb8-4fd3-910c-068f845ffe45 tempest-VolumesServicesTestJSON-1276274017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:53 devstack sudo[91636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:16:53 devstack sudo[91636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:54 devstack sudo[91636]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f53729fb-3eb8-4fd3-910c-068f845ffe45 tempest-VolumesServicesTestJSON-1276274017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.366s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:54 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-f53729fb-3eb8-4fd3-910c-068f845ffe45 tempest-VolumesServicesTestJSON-1276274017 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:16:54 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-f53729fb-3eb8-4fd3-910c-068f845ffe45 tempest-VolumesServicesTestJSON-1276274017 None] Deleted volume successfully. Sep 01 08:16:54 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f53729fb-3eb8-4fd3-910c-068f845ffe45 tempest-VolumesServicesTestJSON-1276274017 None] Lock "cinder-96cca0a0-719a-46df-8494-7f3d1f4b041f-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:16:54 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:16:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] Flow 'volume_create_manager' (d8d7e0a9-5483-466f-a87b-297951765fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:16:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (043b2ab3-d57a-43be-9751-bd655b585010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (043b2ab3-d57a-43be-9751-bd655b585010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2044432937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5cc9379-8174-451d-9c87-03bebe38d471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbf10aeb0a324e1a828d1ee1d8611872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:16:54Z,use_quota=True,user_id='15eb6ac21b104a0a8e7c41a087ecd646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dd92003-8dcc-4821-85a1-6b5e4e01f3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dd92003-8dcc-4821-85a1-6b5e4e01f3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6594446b-ae45-4969-8b55-3b8713a613c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6594446b-ae45-4969-8b55-3b8713a613c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5cc9379-8174-451d-9c87-03bebe38d471', 'volume_name': 'volume-e5cc9379-8174-451d-9c87-03bebe38d471', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba519b05-dfdb-4255-9214-a48a2b07698f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba519b05-dfdb-4255-9214-a48a2b07698f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daab25ac-0133-4f13-9fcb-daa2d019a0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:54 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] Volume e5cc9379-8174-451d-9c87-03bebe38d471: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5cc9379-8174-451d-9c87-03bebe38d471', 'volume_size': 1} Sep 01 08:16:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:16:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:16:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2044432937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5cc9379-8174-451d-9c87-03bebe38d471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbf10aeb0a324e1a828d1ee1d8611872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:16:54Z,use_quota=True,user_id='15eb6ac21b104a0a8e7c41a087ecd646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:16:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] Creating volume e5cc9379-8174-451d-9c87-03bebe38d471 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:16:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:16:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:16:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:16:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:16:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:16:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:16:54 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:16:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5cc9379-8174-451d-9c87-03bebe38d471 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:54 devstack sudo[91639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5cc9379-8174-451d-9c87-03bebe38d471 1073741824 Sep 01 08:16:54 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:54 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5cc9379-8174-451d-9c87-03bebe38d471 1073741824" returned: 0 in 0.482s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5cc9379-8174-451d-9c87-03bebe38d471 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:55 devstack sudo[91645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5cc9379-8174-451d-9c87-03bebe38d471 Sep 01 08:16:55 devstack sudo[91645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:55 devstack sudo[91645]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5cc9379-8174-451d-9c87-03bebe38d471" returned: 0 in 0.264s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:55 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:16:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:16:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daab25ac-0133-4f13-9fcb-daa2d019a0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5cc9379-8174-451d-9c87-03bebe38d471', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3483f3bd-9ce3-4a9f-b50a-2275535311eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:55 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] Volume volume-e5cc9379-8174-451d-9c87-03bebe38d471 (e5cc9379-8174-451d-9c87-03bebe38d471): created successfully Sep 01 08:16:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3483f3bd-9ce3-4a9f-b50a-2275535311eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] Flow 'volume_create_manager' (d8d7e0a9-5483-466f-a87b-297951765fbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:16:55 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-6cb4945e-b64e-456b-b56c-9910d5982bee tempest-VolumesTransfersV355Test-1132404614 None] Created volume successfully. Sep 01 08:16:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1a077f63-3232-402b-9543-5ba52cb945e9 tempest-VolumesTransfersV355Test-313779434 None] Acquiring lock "cinder-e5cc9379-8174-451d-9c87-03bebe38d471-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:16:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1a077f63-3232-402b-9543-5ba52cb945e9 tempest-VolumesTransfersV355Test-313779434 None] Lock "cinder-e5cc9379-8174-451d-9c87-03bebe38d471-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] Flow 'volume_create_manager' (fbd0d84a-3e5d-425c-97f0-d5c2d0d35506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0f9c8b7-75b6-4eae-b30d-791b2b154933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1a077f63-3232-402b-9543-5ba52cb945e9 tempest-VolumesTransfersV355Test-313779434 None] Acquiring lock "cinder-quobyte-e5cc9379-8174-451d-9c87-03bebe38d471" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0f9c8b7-75b6-4eae-b30d-791b2b154933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1571578021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94b13d40-8ba1-4f53-976a-94785c1180e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3e5a848c0824288be99c28973b8f928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:16:57Z,use_quota=True,user_id='f49a63330b8e452c9d7b3cca3ec04d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c61a93-bb23-4909-bea4-959e10063e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c61a93-bb23-4909-bea4-959e10063e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fedb41f3-9fc2-4d4b-8c54-c8242d206396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fedb41f3-9fc2-4d4b-8c54-c8242d206396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94b13d40-8ba1-4f53-976a-94785c1180e7', 'volume_name': 'volume-94b13d40-8ba1-4f53-976a-94785c1180e7', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (018fb46a-7d2f-4dca-ae8f-a9956aeb4ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (018fb46a-7d2f-4dca-ae8f-a9956aeb4ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a1dd76d-03cc-4c43-b714-fed625e619f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:57 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] Volume 94b13d40-8ba1-4f53-976a-94785c1180e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94b13d40-8ba1-4f53-976a-94785c1180e7', 'volume_size': 1} Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1571578021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94b13d40-8ba1-4f53-976a-94785c1180e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3e5a848c0824288be99c28973b8f928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:16:57Z,use_quota=True,user_id='f49a63330b8e452c9d7b3cca3ec04d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] Creating volume 94b13d40-8ba1-4f53-976a-94785c1180e7 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:16:57 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-94b13d40-8ba1-4f53-976a-94785c1180e7 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1a077f63-3232-402b-9543-5ba52cb945e9 tempest-VolumesTransfersV355Test-313779434 None] Lock "cinder-quobyte-e5cc9379-8174-451d-9c87-03bebe38d471" acquired by "delete_volume" :: waited 0.088s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:16:57 devstack sudo[91651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-94b13d40-8ba1-4f53-976a-94785c1180e7 1073741824 Sep 01 08:16:57 devstack sudo[91651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5876c87-115a-4d10-b72c-2b80ce1c61ea]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1a077f63-3232-402b-9543-5ba52cb945e9 tempest-VolumesTransfersV355Test-313779434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5cc9379-8174-451d-9c87-03bebe38d471 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:57 devstack sudo[91653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5cc9379-8174-451d-9c87-03bebe38d471 Sep 01 08:16:57 devstack sudo[91653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:57 devstack sudo[91653]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1a077f63-3232-402b-9543-5ba52cb945e9 tempest-VolumesTransfersV355Test-313779434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5cc9379-8174-451d-9c87-03bebe38d471" returned: 0 in 0.426s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1a077f63-3232-402b-9543-5ba52cb945e9 tempest-VolumesTransfersV355Test-313779434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5cc9379-8174-451d-9c87-03bebe38d471 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:57 devstack sudo[91651]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-94b13d40-8ba1-4f53-976a-94785c1180e7 1073741824" returned: 0 in 0.519s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:57 devstack sudo[91663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5cc9379-8174-451d-9c87-03bebe38d471 Sep 01 08:16:57 devstack sudo[91663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-94b13d40-8ba1-4f53-976a-94785c1180e7 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:57 devstack sudo[91665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-94b13d40-8ba1-4f53-976a-94785c1180e7 Sep 01 08:16:57 devstack sudo[91665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:57 devstack sudo[91663]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1a077f63-3232-402b-9543-5ba52cb945e9 tempest-VolumesTransfersV355Test-313779434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5cc9379-8174-451d-9c87-03bebe38d471" returned: 0 in 0.299s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1a077f63-3232-402b-9543-5ba52cb945e9 tempest-VolumesTransfersV355Test-313779434 None] Lock "cinder-quobyte-e5cc9379-8174-451d-9c87-03bebe38d471" released by "delete_volume" :: held 0.790s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:16:58 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-1a077f63-3232-402b-9543-5ba52cb945e9 tempest-VolumesTransfersV355Test-313779434 None] Created reservations ['261db6f7-3d32-4e2c-a1aa-9e46fac0f8bf', '9f126965-fb49-4c86-bf03-60cb29c0ae7d', '87e8ee0e-f7a8-447d-8e28-66856fae5329', '288e2370-1e2f-49cc-af8e-718dc50c4215'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:16:58 devstack sudo[91665]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-94b13d40-8ba1-4f53-976a-94785c1180e7" returned: 0 in 0.368s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:16:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:16:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a1dd76d-03cc-4c43-b714-fed625e619f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94b13d40-8ba1-4f53-976a-94785c1180e7', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79353c0d-1d7c-4f6c-aece-e645d0e4589a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:16:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1a077f63-3232-402b-9543-5ba52cb945e9 tempest-VolumesTransfersV355Test-313779434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:16:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1a077f63-3232-402b-9543-5ba52cb945e9 tempest-VolumesTransfersV355Test-313779434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:16:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1a077f63-3232-402b-9543-5ba52cb945e9 tempest-VolumesTransfersV355Test-313779434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:16:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1a077f63-3232-402b-9543-5ba52cb945e9 tempest-VolumesTransfersV355Test-313779434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:16:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1a077f63-3232-402b-9543-5ba52cb945e9 tempest-VolumesTransfersV355Test-313779434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:16:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1a077f63-3232-402b-9543-5ba52cb945e9 tempest-VolumesTransfersV355Test-313779434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:16:58 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] Volume volume-94b13d40-8ba1-4f53-976a-94785c1180e7 (94b13d40-8ba1-4f53-976a-94785c1180e7): created successfully Sep 01 08:16:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79353c0d-1d7c-4f6c-aece-e645d0e4589a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:16:58 devstack sudo[91669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:16:58 devstack sudo[91669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:16:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] Flow 'volume_create_manager' (fbd0d84a-3e5d-425c-97f0-d5c2d0d35506) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:16:58 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-d595e544-f2fe-4b2e-9588-b94ff75c1897 tempest-AttachVolumeShelveTestJSON-711447314 None] Created volume successfully. Sep 01 08:16:58 devstack sudo[91669]: pam_unix(sudo:session): session closed for user root Sep 01 08:16:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1a077f63-3232-402b-9543-5ba52cb945e9 tempest-VolumesTransfersV355Test-313779434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.270s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:16:58 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-1a077f63-3232-402b-9543-5ba52cb945e9 tempest-VolumesTransfersV355Test-313779434 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:16:58 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-1a077f63-3232-402b-9543-5ba52cb945e9 tempest-VolumesTransfersV355Test-313779434 None] Deleted volume successfully. Sep 01 08:16:58 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1a077f63-3232-402b-9543-5ba52cb945e9 tempest-VolumesTransfersV355Test-313779434 None] Lock "cinder-e5cc9379-8174-451d-9c87-03bebe38d471-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:17:01 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:17:01 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] Flow 'volume_create_manager' (1eee18cd-d91d-4189-8699-18c0b2bef7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:17:01 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9907fb6-a771-4911-a6c1-96bef40c0292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:01 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9907fb6-a771-4911-a6c1-96bef40c0292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1921309625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=300cbea9-8ac4-4b80-bdc6-41bf2640edae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3cc3984bfe48078dfd1aadc289ed08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:17:01Z,use_quota=True,user_id='882d6d63d9cf4e66a3772994ac15fe4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ff1b3f0-76c4-47f3-92a3-2eb4a1c91c23),volume_type_id=1ff1b3f0-76c4-47f3-92a3-2eb4a1c91c23)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:01 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4215d963-1779-497f-91e8-3e1d29b1bf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:01 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4215d963-1779-497f-91e8-3e1d29b1bf42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:01 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a33402-3146-428c-bb36-9c0364516d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:01 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a33402-3146-428c-bb36-9c0364516d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '300cbea9-8ac4-4b80-bdc6-41bf2640edae', 'volume_name': 'volume-300cbea9-8ac4-4b80-bdc6-41bf2640edae', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:01 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a56d36e9-5802-4e0c-8089-3ba24e2f880e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:01 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a56d36e9-5802-4e0c-8089-3ba24e2f880e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:01 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a462f0b-1d75-4d8e-8d43-5c501e1b56dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:01 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] Volume 300cbea9-8ac4-4b80-bdc6-41bf2640edae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-300cbea9-8ac4-4b80-bdc6-41bf2640edae', 'volume_size': 1} Sep 01 08:17:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:01 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1921309625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=300cbea9-8ac4-4b80-bdc6-41bf2640edae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3cc3984bfe48078dfd1aadc289ed08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:17:01Z,use_quota=True,user_id='882d6d63d9cf4e66a3772994ac15fe4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ff1b3f0-76c4-47f3-92a3-2eb4a1c91c23),volume_type_id=1ff1b3f0-76c4-47f3-92a3-2eb4a1c91c23)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:17:01 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] Creating volume 300cbea9-8ac4-4b80-bdc6-41bf2640edae {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:17:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:01 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:17:01 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:17:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:01 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:17:01 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:17:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-300cbea9-8ac4-4b80-bdc6-41bf2640edae 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:01 devstack sudo[91727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-300cbea9-8ac4-4b80-bdc6-41bf2640edae 1073741824 Sep 01 08:17:01 devstack sudo[91727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:02 devstack sudo[91727]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-300cbea9-8ac4-4b80-bdc6-41bf2640edae 1073741824" returned: 0 in 0.535s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-300cbea9-8ac4-4b80-bdc6-41bf2640edae {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:02 devstack sudo[91736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-300cbea9-8ac4-4b80-bdc6-41bf2640edae Sep 01 08:17:02 devstack sudo[91736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:02 devstack sudo[91736]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-300cbea9-8ac4-4b80-bdc6-41bf2640edae" returned: 0 in 0.295s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:02 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:17:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:02 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a462f0b-1d75-4d8e-8d43-5c501e1b56dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-300cbea9-8ac4-4b80-bdc6-41bf2640edae', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:02 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a305d6fb-41cb-4ec2-8932-a3e21440db83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:02 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] Volume volume-300cbea9-8ac4-4b80-bdc6-41bf2640edae (300cbea9-8ac4-4b80-bdc6-41bf2640edae): created successfully Sep 01 08:17:02 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a305d6fb-41cb-4ec2-8932-a3e21440db83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:02 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] Flow 'volume_create_manager' (1eee18cd-d91d-4189-8699-18c0b2bef7e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:17:02 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-27c0662c-166f-4d26-bfb9-19b3da4fedc6 tempest-VolumeTypesAccessTest-1476624037 None] Created volume successfully. Sep 01 08:17:03 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0a4ee61f-2367-461a-82b3-6259a7546c04 tempest-VolumeTypesAccessTest-1476624037 None] Acquiring lock "cinder-300cbea9-8ac4-4b80-bdc6-41bf2640edae-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:17:03 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0a4ee61f-2367-461a-82b3-6259a7546c04 tempest-VolumeTypesAccessTest-1476624037 None] Lock "cinder-300cbea9-8ac4-4b80-bdc6-41bf2640edae-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:17:03 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0a4ee61f-2367-461a-82b3-6259a7546c04 tempest-VolumeTypesAccessTest-1476624037 None] Acquiring lock "cinder-quobyte-300cbea9-8ac4-4b80-bdc6-41bf2640edae" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:17:03 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0a4ee61f-2367-461a-82b3-6259a7546c04 tempest-VolumeTypesAccessTest-1476624037 None] Lock "cinder-quobyte-300cbea9-8ac4-4b80-bdc6-41bf2640edae" acquired by "delete_volume" :: waited 0.021s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:17:03 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e18c7e5-53eb-4e8e-9d08-19be37d903fb]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:17:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0a4ee61f-2367-461a-82b3-6259a7546c04 tempest-VolumeTypesAccessTest-1476624037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-300cbea9-8ac4-4b80-bdc6-41bf2640edae {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:03 devstack sudo[91740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-300cbea9-8ac4-4b80-bdc6-41bf2640edae Sep 01 08:17:03 devstack sudo[91740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:04 devstack sudo[91740]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0a4ee61f-2367-461a-82b3-6259a7546c04 tempest-VolumeTypesAccessTest-1476624037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-300cbea9-8ac4-4b80-bdc6-41bf2640edae" returned: 0 in 0.384s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0a4ee61f-2367-461a-82b3-6259a7546c04 tempest-VolumeTypesAccessTest-1476624037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-300cbea9-8ac4-4b80-bdc6-41bf2640edae {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:04 devstack sudo[91745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-300cbea9-8ac4-4b80-bdc6-41bf2640edae Sep 01 08:17:04 devstack sudo[91745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:04 devstack sudo[91745]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0a4ee61f-2367-461a-82b3-6259a7546c04 tempest-VolumeTypesAccessTest-1476624037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-300cbea9-8ac4-4b80-bdc6-41bf2640edae" returned: 0 in 0.296s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:04 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0a4ee61f-2367-461a-82b3-6259a7546c04 tempest-VolumeTypesAccessTest-1476624037 None] Lock "cinder-quobyte-300cbea9-8ac4-4b80-bdc6-41bf2640edae" released by "delete_volume" :: held 0.737s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:17:04 devstack cinder-volume[86893]: WARNING cinder.quota [None req-0a4ee61f-2367-461a-82b3-6259a7546c04 tempest-VolumeTypesAccessTest-1476624037 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-214403631 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-214403631, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:17:04 devstack cinder-volume[86893]: WARNING cinder.quota [None req-0a4ee61f-2367-461a-82b3-6259a7546c04 tempest-VolumeTypesAccessTest-1476624037 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-214403631 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-214403631, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:17:04 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-0a4ee61f-2367-461a-82b3-6259a7546c04 tempest-VolumeTypesAccessTest-1476624037 None] Created reservations ['6bc4c456-2a4c-4f88-93b2-aa19384d0651', 'cd37e848-13c3-4bfd-bc70-9376d88fa6d2', 'b3f7d618-28cc-4487-9f15-2511a3ba80ed', '0a65fca4-efd9-4df1-b1c8-ba50f16e89ce'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:17:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0a4ee61f-2367-461a-82b3-6259a7546c04 tempest-VolumeTypesAccessTest-1476624037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0a4ee61f-2367-461a-82b3-6259a7546c04 tempest-VolumeTypesAccessTest-1476624037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:04 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0a4ee61f-2367-461a-82b3-6259a7546c04 tempest-VolumeTypesAccessTest-1476624037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:17:04 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0a4ee61f-2367-461a-82b3-6259a7546c04 tempest-VolumeTypesAccessTest-1476624037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:17:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0a4ee61f-2367-461a-82b3-6259a7546c04 tempest-VolumeTypesAccessTest-1476624037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0a4ee61f-2367-461a-82b3-6259a7546c04 tempest-VolumeTypesAccessTest-1476624037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:04 devstack sudo[91748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:17:04 devstack sudo[91748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:04 devstack sudo[91748]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0a4ee61f-2367-461a-82b3-6259a7546c04 tempest-VolumeTypesAccessTest-1476624037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.259s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:04 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-0a4ee61f-2367-461a-82b3-6259a7546c04 tempest-VolumeTypesAccessTest-1476624037 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:17:04 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-0a4ee61f-2367-461a-82b3-6259a7546c04 tempest-VolumeTypesAccessTest-1476624037 None] Deleted volume successfully. Sep 01 08:17:04 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0a4ee61f-2367-461a-82b3-6259a7546c04 tempest-VolumeTypesAccessTest-1476624037 None] Lock "cinder-300cbea9-8ac4-4b80-bdc6-41bf2640edae-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:17:06 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:17:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] Flow 'volume_create_manager' (cee9160e-fefa-453a-8c99-f1f77c15a59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:17:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ba8c90-c74e-4d0f-8453-7b78ff153073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ba8c90-c74e-4d0f-8453-7b78ff153073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-756617128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e516841-41e4-47d7-b62b-b7b5ac6c88cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63697dc05da44179859b64a7f136c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:17:07Z,use_quota=True,user_id='994151b129d24b4f95107e47a75432b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce01ca4-877b-419b-9317-d8b38a30b969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce01ca4-877b-419b-9317-d8b38a30b969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65ee9b98-6ffc-437d-9bc6-2055d84393b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65ee9b98-6ffc-437d-9bc6-2055d84393b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e516841-41e4-47d7-b62b-b7b5ac6c88cc', 'volume_name': 'volume-5e516841-41e4-47d7-b62b-b7b5ac6c88cc', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f2cae39-0ca9-4182-96ec-4d8df45f91ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f2cae39-0ca9-4182-96ec-4d8df45f91ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48664d7c-f2ff-4064-9e0c-05bad902e45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:07 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] Volume 5e516841-41e4-47d7-b62b-b7b5ac6c88cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e516841-41e4-47d7-b62b-b7b5ac6c88cc', 'volume_size': 1} Sep 01 08:17:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:07 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-756617128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e516841-41e4-47d7-b62b-b7b5ac6c88cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63697dc05da44179859b64a7f136c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:17:07Z,use_quota=True,user_id='994151b129d24b4f95107e47a75432b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:17:07 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] Creating volume 5e516841-41e4-47d7-b62b-b7b5ac6c88cc {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:17:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:07 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:17:07 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:17:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:07 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:17:07 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:17:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5e516841-41e4-47d7-b62b-b7b5ac6c88cc 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:07 devstack sudo[91774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5e516841-41e4-47d7-b62b-b7b5ac6c88cc 1073741824 Sep 01 08:17:07 devstack sudo[91774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:07 devstack sudo[91774]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5e516841-41e4-47d7-b62b-b7b5ac6c88cc 1073741824" returned: 0 in 0.499s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5e516841-41e4-47d7-b62b-b7b5ac6c88cc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:07 devstack sudo[91780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5e516841-41e4-47d7-b62b-b7b5ac6c88cc Sep 01 08:17:07 devstack sudo[91780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:07 devstack sudo[91780]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5e516841-41e4-47d7-b62b-b7b5ac6c88cc" returned: 0 in 0.246s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:07 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:17:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48664d7c-f2ff-4064-9e0c-05bad902e45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e516841-41e4-47d7-b62b-b7b5ac6c88cc', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2b00bc7-4e0a-4f7b-a674-7d03e6110d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:07 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] Volume volume-5e516841-41e4-47d7-b62b-b7b5ac6c88cc (5e516841-41e4-47d7-b62b-b7b5ac6c88cc): created successfully Sep 01 08:17:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2b00bc7-4e0a-4f7b-a674-7d03e6110d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] Flow 'volume_create_manager' (cee9160e-fefa-453a-8c99-f1f77c15a59a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:17:07 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-e486c127-b059-47c2-ac8c-181483382ceb tempest-VolumesTransfersV357Test-1442091809 None] Created volume successfully. Sep 01 08:17:09 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-4209ada4-f20f-401b-95b0-05a7358d20e2 req-a0587a27-1ddf-4c36-94a8-72e21785d5ea tempest-AttachVolumeShelveTestJSON-711447314 None] No connector for attachment 7dd23bd1-9f48-4bcc-b858-81fe0bf07861; skipping storage backend terminate_connection call. {{(pid=86893) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 01 08:17:09 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-4209ada4-f20f-401b-95b0-05a7358d20e2 req-a0587a27-1ddf-4c36-94a8-72e21785d5ea tempest-AttachVolumeShelveTestJSON-711447314 None] Deleting attachment 7dd23bd1-9f48-4bcc-b858-81fe0bf07861. {{(pid=86893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 08:17:09 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-530e08bc-4491-4de2-bd2b-b456a6988289 tempest-VolumesTransfersV357Test-229665933 None] Transfer volume completed successfully. Sep 01 08:17:10 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d69eed7b-cde9-4ae0-b270-d7b873f80555 tempest-VolumesTransfersV357Test-1629946780 None] Acquiring lock "cinder-5e516841-41e4-47d7-b62b-b7b5ac6c88cc-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:17:10 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d69eed7b-cde9-4ae0-b270-d7b873f80555 tempest-VolumesTransfersV357Test-1629946780 None] Lock "cinder-5e516841-41e4-47d7-b62b-b7b5ac6c88cc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:17:10 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d69eed7b-cde9-4ae0-b270-d7b873f80555 tempest-VolumesTransfersV357Test-1629946780 None] Acquiring lock "cinder-quobyte-5e516841-41e4-47d7-b62b-b7b5ac6c88cc" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:17:10 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d69eed7b-cde9-4ae0-b270-d7b873f80555 tempest-VolumesTransfersV357Test-1629946780 None] Lock "cinder-quobyte-5e516841-41e4-47d7-b62b-b7b5ac6c88cc" acquired by "delete_volume" :: waited 0.028s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:17:10 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7eb4cc7-d60a-4d78-95a1-d99a1bee749b]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:17:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d69eed7b-cde9-4ae0-b270-d7b873f80555 tempest-VolumesTransfersV357Test-1629946780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5e516841-41e4-47d7-b62b-b7b5ac6c88cc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:11 devstack sudo[91794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5e516841-41e4-47d7-b62b-b7b5ac6c88cc Sep 01 08:17:11 devstack sudo[91794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:11 devstack sudo[91794]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d69eed7b-cde9-4ae0-b270-d7b873f80555 tempest-VolumesTransfersV357Test-1629946780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5e516841-41e4-47d7-b62b-b7b5ac6c88cc" returned: 0 in 0.492s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d69eed7b-cde9-4ae0-b270-d7b873f80555 tempest-VolumesTransfersV357Test-1629946780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5e516841-41e4-47d7-b62b-b7b5ac6c88cc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:11 devstack sudo[91800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5e516841-41e4-47d7-b62b-b7b5ac6c88cc Sep 01 08:17:11 devstack sudo[91800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:11 devstack sudo[91800]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d69eed7b-cde9-4ae0-b270-d7b873f80555 tempest-VolumesTransfersV357Test-1629946780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5e516841-41e4-47d7-b62b-b7b5ac6c88cc" returned: 0 in 0.347s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:11 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d69eed7b-cde9-4ae0-b270-d7b873f80555 tempest-VolumesTransfersV357Test-1629946780 None] Lock "cinder-quobyte-5e516841-41e4-47d7-b62b-b7b5ac6c88cc" released by "delete_volume" :: held 0.900s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:17:11 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-d69eed7b-cde9-4ae0-b270-d7b873f80555 tempest-VolumesTransfersV357Test-1629946780 None] Created reservations ['fe5f8271-a4f2-448f-bb6f-9b1d05fa078c', '294edce4-de15-42b2-86cc-fd63920eed2f', 'd080057a-5431-408e-9c9d-8f9a2655bbe2', '446c3440-69f1-444c-afc4-71ca715742ef'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:17:11 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:17:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] Flow 'volume_create_manager' (32cd7a14-5817-45a6-a2fb-fe26f56c7cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:17:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6484600-edeb-4121-a91c-992749c6649c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6484600-edeb-4121-a91c-992749c6649c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-825907347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad6d880a-963c-4096-9d07-852030be6b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6077fb93911b4606bad99ba0e2135a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:17:12Z,use_quota=True,user_id='e078512b36624dd28375f44443b35a2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411f38ba-2025-4350-93c5-e29aebced500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411f38ba-2025-4350-93c5-e29aebced500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca10348-0ed5-4fc7-98e4-f8661237c232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca10348-0ed5-4fc7-98e4-f8661237c232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad6d880a-963c-4096-9d07-852030be6b64', 'volume_name': 'volume-ad6d880a-963c-4096-9d07-852030be6b64', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4064cc23-68b2-45ea-ace9-5436a7bfad51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4064cc23-68b2-45ea-ace9-5436a7bfad51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d993bd78-2aab-49ba-ac71-4fcefce80eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:12 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] Volume ad6d880a-963c-4096-9d07-852030be6b64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad6d880a-963c-4096-9d07-852030be6b64', 'volume_size': 1} Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-825907347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad6d880a-963c-4096-9d07-852030be6b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6077fb93911b4606bad99ba0e2135a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:17:12Z,use_quota=True,user_id='e078512b36624dd28375f44443b35a2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] Creating volume ad6d880a-963c-4096-9d07-852030be6b64 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:17:12 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ad6d880a-963c-4096-9d07-852030be6b64 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:12 devstack sudo[91805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ad6d880a-963c-4096-9d07-852030be6b64 1073741824 Sep 01 08:17:12 devstack sudo[91805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d69eed7b-cde9-4ae0-b270-d7b873f80555 tempest-VolumesTransfersV357Test-1629946780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d69eed7b-cde9-4ae0-b270-d7b873f80555 tempest-VolumesTransfersV357Test-1629946780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d69eed7b-cde9-4ae0-b270-d7b873f80555 tempest-VolumesTransfersV357Test-1629946780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d69eed7b-cde9-4ae0-b270-d7b873f80555 tempest-VolumesTransfersV357Test-1629946780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d69eed7b-cde9-4ae0-b270-d7b873f80555 tempest-VolumesTransfersV357Test-1629946780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d69eed7b-cde9-4ae0-b270-d7b873f80555 tempest-VolumesTransfersV357Test-1629946780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:12 devstack sudo[91807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:17:12 devstack sudo[91807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:12 devstack sudo[91807]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d69eed7b-cde9-4ae0-b270-d7b873f80555 tempest-VolumesTransfersV357Test-1629946780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.287s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-d69eed7b-cde9-4ae0-b270-d7b873f80555 tempest-VolumesTransfersV357Test-1629946780 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:17:12 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-d69eed7b-cde9-4ae0-b270-d7b873f80555 tempest-VolumesTransfersV357Test-1629946780 None] Deleted volume successfully. Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d69eed7b-cde9-4ae0-b270-d7b873f80555 tempest-VolumesTransfersV357Test-1629946780 None] Lock "cinder-5e516841-41e4-47d7-b62b-b7b5ac6c88cc-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:17:12 devstack sudo[91805]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ad6d880a-963c-4096-9d07-852030be6b64 1073741824" returned: 0 in 0.547s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ad6d880a-963c-4096-9d07-852030be6b64 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:12 devstack sudo[91815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ad6d880a-963c-4096-9d07-852030be6b64 Sep 01 08:17:12 devstack sudo[91815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:12 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-bed2fc4a-e12e-4b67-88a0-572c69dd7c84 req-5b18d3a9-85d4-48f1-9daa-b7ece61accf0 tempest-ServerActionsTestOtherA-1037332526 None] Terminate volume connection completed successfully. Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-bed2fc4a-e12e-4b67-88a0-572c69dd7c84 req-5b18d3a9-85d4-48f1-9daa-b7ece61accf0 tempest-ServerActionsTestOtherA-1037332526 None] Deleting attachment 4d298fe9-80a9-42b1-bad9-f31f83e13366. {{(pid=86893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 08:17:12 devstack sudo[91815]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ad6d880a-963c-4096-9d07-852030be6b64" returned: 0 in 0.294s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d993bd78-2aab-49ba-ac71-4fcefce80eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad6d880a-963c-4096-9d07-852030be6b64', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19a9ce02-0a46-43a2-9536-4982f0e9a495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:12 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] Volume volume-ad6d880a-963c-4096-9d07-852030be6b64 (ad6d880a-963c-4096-9d07-852030be6b64): created successfully Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19a9ce02-0a46-43a2-9536-4982f0e9a495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:12 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] Flow 'volume_create_manager' (32cd7a14-5817-45a6-a2fb-fe26f56c7cee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:17:12 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-9352fd8a-6885-4197-a117-c1af35b2da31 tempest-VolumesMetadataTest-991484600 None] Created volume successfully. Sep 01 08:17:13 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=99,cinder:UPDATE=102,cinder:INSERT=24,cinder:DELETE=10 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:17:13 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=71,cinder:UPDATE=116,cinder:INSERT=23,cinder:DELETE=10 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:17:13 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:17:13 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] Flow 'volume_create_manager' (061a5aa3-455c-49ff-b9b4-1b54ea1476cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:17:13 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc86173d-1b0f-47fd-8ea4-3a0f734d2c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc86173d-1b0f-47fd-8ea4-3a0f734d2c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2063862680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03331414-b4af-464b-9393-6a1fd6fca71c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63697dc05da44179859b64a7f136c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:17:14Z,use_quota=True,user_id='994151b129d24b4f95107e47a75432b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c42610-5093-43d7-a753-1ffa506c3a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c42610-5093-43d7-a753-1ffa506c3a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2721e130-46fd-4e73-a792-4b9e1a00a578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2721e130-46fd-4e73-a792-4b9e1a00a578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03331414-b4af-464b-9393-6a1fd6fca71c', 'volume_name': 'volume-03331414-b4af-464b-9393-6a1fd6fca71c', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaad55ac-7d00-49b2-8b68-d739cc289d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaad55ac-7d00-49b2-8b68-d739cc289d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56413bb-f64e-499d-8848-e129c46f4c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:14 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] Volume 03331414-b4af-464b-9393-6a1fd6fca71c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03331414-b4af-464b-9393-6a1fd6fca71c', 'volume_size': 1} Sep 01 08:17:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:14 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2063862680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03331414-b4af-464b-9393-6a1fd6fca71c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63697dc05da44179859b64a7f136c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:17:14Z,use_quota=True,user_id='994151b129d24b4f95107e47a75432b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:17:14 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] Creating volume 03331414-b4af-464b-9393-6a1fd6fca71c {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:17:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:14 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:17:14 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:17:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:14 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:17:14 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:17:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-03331414-b4af-464b-9393-6a1fd6fca71c 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:14 devstack sudo[91841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-03331414-b4af-464b-9393-6a1fd6fca71c 1073741824 Sep 01 08:17:14 devstack sudo[91841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:14 devstack sudo[91841]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-03331414-b4af-464b-9393-6a1fd6fca71c 1073741824" returned: 0 in 0.610s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-03331414-b4af-464b-9393-6a1fd6fca71c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:14 devstack sudo[91851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-03331414-b4af-464b-9393-6a1fd6fca71c Sep 01 08:17:14 devstack sudo[91851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:15 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7f8a3541-f8da-4d82-8065-564768b6a37e tempest-VolumesMetadataTest-991484600 None] Acquiring lock "cinder-ad6d880a-963c-4096-9d07-852030be6b64-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:17:15 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7f8a3541-f8da-4d82-8065-564768b6a37e tempest-VolumesMetadataTest-991484600 None] Lock "cinder-ad6d880a-963c-4096-9d07-852030be6b64-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:17:15 devstack sudo[91851]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-03331414-b4af-464b-9393-6a1fd6fca71c" returned: 0 in 0.386s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:17:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56413bb-f64e-499d-8848-e129c46f4c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03331414-b4af-464b-9393-6a1fd6fca71c', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f139aa-eb69-4534-a477-63659b898e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:15 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] Volume volume-03331414-b4af-464b-9393-6a1fd6fca71c (03331414-b4af-464b-9393-6a1fd6fca71c): created successfully Sep 01 08:17:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f139aa-eb69-4534-a477-63659b898e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] Flow 'volume_create_manager' (061a5aa3-455c-49ff-b9b4-1b54ea1476cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:17:15 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7f8a3541-f8da-4d82-8065-564768b6a37e tempest-VolumesMetadataTest-991484600 None] Acquiring lock "cinder-quobyte-ad6d880a-963c-4096-9d07-852030be6b64" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:17:15 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-2dc30ab8-0671-4a4f-a49f-45b2ff3bbcb0 tempest-VolumesTransfersV357Test-1442091809 None] Created volume successfully. Sep 01 08:17:15 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7f8a3541-f8da-4d82-8065-564768b6a37e tempest-VolumesMetadataTest-991484600 None] Lock "cinder-quobyte-ad6d880a-963c-4096-9d07-852030be6b64" acquired by "delete_volume" :: waited 0.022s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:17:15 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[71688867-bccc-4432-83f4-796a07af74f3]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:17:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7f8a3541-f8da-4d82-8065-564768b6a37e tempest-VolumesMetadataTest-991484600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ad6d880a-963c-4096-9d07-852030be6b64 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:15 devstack sudo[91856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ad6d880a-963c-4096-9d07-852030be6b64 Sep 01 08:17:15 devstack sudo[91856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:15 devstack sudo[91856]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7f8a3541-f8da-4d82-8065-564768b6a37e tempest-VolumesMetadataTest-991484600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ad6d880a-963c-4096-9d07-852030be6b64" returned: 0 in 0.435s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7f8a3541-f8da-4d82-8065-564768b6a37e tempest-VolumesMetadataTest-991484600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ad6d880a-963c-4096-9d07-852030be6b64 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:15 devstack sudo[91862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ad6d880a-963c-4096-9d07-852030be6b64 Sep 01 08:17:15 devstack sudo[91862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:16 devstack sudo[91862]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7f8a3541-f8da-4d82-8065-564768b6a37e tempest-VolumesMetadataTest-991484600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ad6d880a-963c-4096-9d07-852030be6b64" returned: 0 in 0.427s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:16 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7f8a3541-f8da-4d82-8065-564768b6a37e tempest-VolumesMetadataTest-991484600 None] Lock "cinder-quobyte-ad6d880a-963c-4096-9d07-852030be6b64" released by "delete_volume" :: held 0.910s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:17:16 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-7f8a3541-f8da-4d82-8065-564768b6a37e tempest-VolumesMetadataTest-991484600 None] Created reservations ['3b7c807c-9ef9-43d1-86c6-74047a2b7356', '4faeb446-e4d1-45e7-8793-a3487b7afeb4', '6e8486e8-3580-4fe6-a007-bc02702d5b37', '5c0f12d5-4391-428c-af99-80fc51c7cee9'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:17:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7f8a3541-f8da-4d82-8065-564768b6a37e tempest-VolumesMetadataTest-991484600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7f8a3541-f8da-4d82-8065-564768b6a37e tempest-VolumesMetadataTest-991484600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7f8a3541-f8da-4d82-8065-564768b6a37e tempest-VolumesMetadataTest-991484600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:17:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7f8a3541-f8da-4d82-8065-564768b6a37e tempest-VolumesMetadataTest-991484600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:17:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7f8a3541-f8da-4d82-8065-564768b6a37e tempest-VolumesMetadataTest-991484600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7f8a3541-f8da-4d82-8065-564768b6a37e tempest-VolumesMetadataTest-991484600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:16 devstack sudo[91867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:17:16 devstack sudo[91867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:16 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6d9692cc-e190-4c85-af6c-9f87fc4a3896 tempest-VolumesTransfersV357Test-1629946780 None] Acquiring lock "cinder-03331414-b4af-464b-9393-6a1fd6fca71c-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:17:16 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6d9692cc-e190-4c85-af6c-9f87fc4a3896 tempest-VolumesTransfersV357Test-1629946780 None] Lock "cinder-03331414-b4af-464b-9393-6a1fd6fca71c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:17:16 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6d9692cc-e190-4c85-af6c-9f87fc4a3896 tempest-VolumesTransfersV357Test-1629946780 None] Acquiring lock "cinder-quobyte-03331414-b4af-464b-9393-6a1fd6fca71c" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:17:16 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6d9692cc-e190-4c85-af6c-9f87fc4a3896 tempest-VolumesTransfersV357Test-1629946780 None] Lock "cinder-quobyte-03331414-b4af-464b-9393-6a1fd6fca71c" acquired by "delete_volume" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:17:16 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb5c29d-972e-4a09-a380-3ac0aa354629]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:17:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6d9692cc-e190-4c85-af6c-9f87fc4a3896 tempest-VolumesTransfersV357Test-1629946780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-03331414-b4af-464b-9393-6a1fd6fca71c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:16 devstack sudo[91867]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7f8a3541-f8da-4d82-8065-564768b6a37e tempest-VolumesMetadataTest-991484600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.388s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:16 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-7f8a3541-f8da-4d82-8065-564768b6a37e tempest-VolumesMetadataTest-991484600 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:17:16 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-7f8a3541-f8da-4d82-8065-564768b6a37e tempest-VolumesMetadataTest-991484600 None] Deleted volume successfully. Sep 01 08:17:16 devstack sudo[91870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-03331414-b4af-464b-9393-6a1fd6fca71c Sep 01 08:17:16 devstack sudo[91870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:16 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7f8a3541-f8da-4d82-8065-564768b6a37e tempest-VolumesMetadataTest-991484600 None] Lock "cinder-ad6d880a-963c-4096-9d07-852030be6b64-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:17:17 devstack sudo[91870]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6d9692cc-e190-4c85-af6c-9f87fc4a3896 tempest-VolumesTransfersV357Test-1629946780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-03331414-b4af-464b-9393-6a1fd6fca71c" returned: 0 in 0.450s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6d9692cc-e190-4c85-af6c-9f87fc4a3896 tempest-VolumesTransfersV357Test-1629946780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-03331414-b4af-464b-9393-6a1fd6fca71c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:17 devstack sudo[91878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-03331414-b4af-464b-9393-6a1fd6fca71c Sep 01 08:17:17 devstack sudo[91878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:17 devstack sudo[91878]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6d9692cc-e190-4c85-af6c-9f87fc4a3896 tempest-VolumesTransfersV357Test-1629946780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-03331414-b4af-464b-9393-6a1fd6fca71c" returned: 0 in 0.355s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:17 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6d9692cc-e190-4c85-af6c-9f87fc4a3896 tempest-VolumesTransfersV357Test-1629946780 None] Lock "cinder-quobyte-03331414-b4af-464b-9393-6a1fd6fca71c" released by "delete_volume" :: held 0.874s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:17:17 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-6d9692cc-e190-4c85-af6c-9f87fc4a3896 tempest-VolumesTransfersV357Test-1629946780 None] Created reservations ['f0b33601-aa71-4fcb-b422-c00a6ddec719', '021101a4-b421-430e-b9d4-0ac4c7ce4e4b', '7d81f962-85b6-451c-a5ad-22cb2a2fb2fe', 'c43fdb76-f89d-402c-ae45-4a553ffacb0d'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:17:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6d9692cc-e190-4c85-af6c-9f87fc4a3896 tempest-VolumesTransfersV357Test-1629946780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6d9692cc-e190-4c85-af6c-9f87fc4a3896 tempest-VolumesTransfersV357Test-1629946780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:17 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6d9692cc-e190-4c85-af6c-9f87fc4a3896 tempest-VolumesTransfersV357Test-1629946780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:17:17 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6d9692cc-e190-4c85-af6c-9f87fc4a3896 tempest-VolumesTransfersV357Test-1629946780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:17:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6d9692cc-e190-4c85-af6c-9f87fc4a3896 tempest-VolumesTransfersV357Test-1629946780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6d9692cc-e190-4c85-af6c-9f87fc4a3896 tempest-VolumesTransfersV357Test-1629946780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:17 devstack sudo[91881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:17:17 devstack sudo[91881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:18 devstack sudo[91881]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6d9692cc-e190-4c85-af6c-9f87fc4a3896 tempest-VolumesTransfersV357Test-1629946780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.358s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:18 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-6d9692cc-e190-4c85-af6c-9f87fc4a3896 tempest-VolumesTransfersV357Test-1629946780 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:17:18 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-6d9692cc-e190-4c85-af6c-9f87fc4a3896 tempest-VolumesTransfersV357Test-1629946780 None] Deleted volume successfully. Sep 01 08:17:18 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6d9692cc-e190-4c85-af6c-9f87fc4a3896 tempest-VolumesTransfersV357Test-1629946780 None] Lock "cinder-03331414-b4af-464b-9393-6a1fd6fca71c-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:17:21 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:17:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Flow 'volume_create_manager' (612b4b7e-02ca-4898-85c8-38e7d50a985f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:17:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db91822-6fd5-48f0-915a-6b1f71199544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db91822-6fd5-48f0-915a-6b1f71199544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1120786753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bacb2011-cf8f-4541-adc0-0b633c7f366a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c735d4e612b94af7947e614d9d0a896b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:17:21Z,use_quota=True,user_id='ebc79b04914d450db588437c83cca103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3010171-a075-4021-8312-313efa5bde90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3010171-a075-4021-8312-313efa5bde90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afb49a34-5b7a-4f86-ab5f-424920ea9965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:21 devstack cinder-volume[86893]: DEBUG cinder.image.glance [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Creating Keystone auth plugin from conf {{(pid=86893) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 08:17:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afb49a34-5b7a-4f86-ab5f-424920ea9965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bacb2011-cf8f-4541-adc0-0b633c7f366a', 'volume_name': 'volume-bacb2011-cf8f-4541-adc0-0b633c7f366a', 'volume_size': 1, 'image_id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a80c3dd0151a4e4aacd690bfb315fb01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'created_at': datetime.datetime(2026, 9, 1, 6, 7, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 6, 7, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df5a5b32-6f96-4c91-8574-795c44e1db21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df5a5b32-6f96-4c91-8574-795c44e1db21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef71c63-533d-40cf-a3ac-34994c664033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:22 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Volume bacb2011-cf8f-4541-adc0-0b633c7f366a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bacb2011-cf8f-4541-adc0-0b633c7f366a', 'volume_size': 1, 'image_id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a80c3dd0151a4e4aacd690bfb315fb01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'created_at': datetime.datetime(2026, 9, 1, 6, 7, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 6, 7, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 08:17:22 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Trying to clone bacb2011-cf8f-4541-adc0-0b633c7f366a from image 00f5a94d-dba5-4527-9ce8-7a00c3b29ced at location (None, [{'url': 'file:///opt/stack/data/glance/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'metadata': {}}]). {{(pid=86893) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1100}} Sep 01 08:17:22 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:17:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] Flow 'volume_create_manager' (39c6f874-d8a7-4020-b4a9-bc2a6da3dbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:17:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ed0540-01f8-4713-98cf-bec9b606a22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ed0540-01f8-4713-98cf-bec9b606a22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-313935875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36b2ea1c06994324be133b65667c3c5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:17:23Z,use_quota=True,user_id='5e20a71811564040980a247cfe1ff44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be6a314-1b38-4c2a-b6fd-c6d9903acba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be6a314-1b38-4c2a-b6fd-c6d9903acba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d658c141-7b6c-4168-b0f9-431077f83cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d658c141-7b6c-4168-b0f9-431077f83cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c', 'volume_name': 'volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (316a90a7-2d57-4cc5-892c-5a10f50944f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (316a90a7-2d57-4cc5-892c-5a10f50944f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a64eac1d-7528-4b6f-8261-2de7c3e7f6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:22 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] Volume 9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c', 'volume_size': 1} Sep 01 08:17:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-313935875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36b2ea1c06994324be133b65667c3c5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:17:23Z,use_quota=True,user_id='5e20a71811564040980a247cfe1ff44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:17:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] Creating volume 9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:17:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:17:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:17:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:17:22 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:17:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:23 devstack sudo[91993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c 1073741824 Sep 01 08:17:23 devstack sudo[91993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:23 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_j29fnqspdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86893) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 08:17:23 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Image download 20.69 MB at 20.69 MB/s Sep 01 08:17:23 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46abe85-099a-4ca5-a285-dde10b677ad0]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:17:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_j29fnqspdevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:23 devstack sudo[92012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_j29fnqspdevstack@QuobyteHD Sep 01 08:17:23 devstack sudo[92012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:23 devstack sudo[91993]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c 1073741824" returned: 0 in 0.902s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:23 devstack sudo[92027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c Sep 01 08:17:23 devstack sudo[92027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:24 devstack sudo[92012]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_j29fnqspdevstack@QuobyteHD" returned: 0 in 0.739s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:24 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Temporary image 00f5a94d-dba5-4527-9ce8-7a00c3b29ced is fetched for user ebc79b04914d450db588437c83cca103. {{(pid=86893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 08:17:24 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a459a72-cc86-4aed-8bca-a51166144483]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:17:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_j29fnqspdevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:24 devstack sudo[92031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_j29fnqspdevstack@QuobyteHD Sep 01 08:17:24 devstack sudo[92031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:24 devstack sudo[92027]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c" returned: 0 in 0.492s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:24 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:17:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a64eac1d-7528-4b6f-8261-2de7c3e7f6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddfee093-b839-4ea1-bfa1-4ce05a01768d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:24 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] Volume volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c (9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c): created successfully Sep 01 08:17:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddfee093-b839-4ea1-bfa1-4ce05a01768d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] Flow 'volume_create_manager' (39c6f874-d8a7-4020-b4a9-bc2a6da3dbb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:17:24 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-3fe1fd83-763f-4d0d-9f0a-358301da7972 tempest-VolumesCloneTest-1123833027 None] Created volume successfully. Sep 01 08:17:24 devstack sudo[92031]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_j29fnqspdevstack@QuobyteHD" returned: 0 in 0.531s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:24 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1120786753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bacb2011-cf8f-4541-adc0-0b633c7f366a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c735d4e612b94af7947e614d9d0a896b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:17:21Z,use_quota=True,user_id='ebc79b04914d450db588437c83cca103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:17:24 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Creating volume bacb2011-cf8f-4541-adc0-0b633c7f366a {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:17:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:24 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:17:24 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:17:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:24 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:17:24 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:17:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bacb2011-cf8f-4541-adc0-0b633c7f366a 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:24 devstack sudo[92039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bacb2011-cf8f-4541-adc0-0b633c7f366a 1073741824 Sep 01 08:17:24 devstack sudo[92039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:25 devstack sudo[92039]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bacb2011-cf8f-4541-adc0-0b633c7f366a 1073741824" returned: 0 in 0.740s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bacb2011-cf8f-4541-adc0-0b633c7f366a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:25 devstack sudo[92048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bacb2011-cf8f-4541-adc0-0b633c7f366a Sep 01 08:17:25 devstack sudo[92048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:25 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:17:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Flow 'volume_create_manager' (6ec27034-3f55-4e84-baee-8d122c30b0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:17:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b091250-27d2-4ad9-a546-24cbedb74a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b091250-27d2-4ad9-a546-24cbedb74a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1870747350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c313394e-51d7-47dc-bb34-72779ee2fd94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36b2ea1c06994324be133b65667c3c5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:17:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c,status='creating',terminated_at=None,updated_at=2026-09-01T06:17:26Z,use_quota=True,user_id='5e20a71811564040980a247cfe1ff44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad9a608-c09e-4c4a-b97d-331c29bf88b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad9a608-c09e-4c4a-b97d-331c29bf88b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e6d492b-b86e-4bf8-adcb-7f617f8fbb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:26 devstack sudo[92048]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bacb2011-cf8f-4541-adc0-0b633c7f366a" returned: 0 in 0.457s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:26 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:17:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.356s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e6d492b-b86e-4bf8-adcb-7f617f8fbb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c313394e-51d7-47dc-bb34-72779ee2fd94', 'volume_name': 'volume-c313394e-51d7-47dc-bb34-72779ee2fd94', 'volume_size': 2, 'source_volid': '9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c', 'source_volstatus': 'available'}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c2e96e7-51f9-4412-9d45-39ec036495b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c2e96e7-51f9-4412-9d45-39ec036495b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cbb05b-bd06-47a4-820f-3bd84497471a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:26 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Volume c313394e-51d7-47dc-bb34-72779ee2fd94: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c313394e-51d7-47dc-bb34-72779ee2fd94', 'volume_size': 2, 'source_volid': '9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c', 'source_volstatus': 'available'} Sep 01 08:17:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:26 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Cloning volume 9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c to volume c313394e-51d7-47dc-bb34-72779ee2fd94 Sep 01 08:17:26 devstack cinder-volume[86893]: DEBUG cinder.volume.volume_utils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Attempting download of 00f5a94d-dba5-4527-9ce8-7a00c3b29ced ((None, [{'url': 'file:///opt/stack/data/glance/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'metadata': {}}])) to volume bacb2011-cf8f-4541-adc0-0b633c7f366a. {{(pid=86893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 08:17:26 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Creating offline snapshot f0ca5602-bfd3-4774-837f-4543032d1702 of volume 9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:17:26 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cca47c-0829-4011-a46e-54dd1aeb5c7c]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:17:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:26 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fade419-9c5c-4187-921c-57adccae4d4b]: (4, 'raw') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:17:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_lk1_hw17 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:26 devstack sudo[92051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c Sep 01 08:17:26 devstack sudo[92051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:26 devstack sudo[92052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_lk1_hw17 Sep 01 08:17:26 devstack sudo[92052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:26 devstack sudo[92051]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c" returned: 0 in 0.451s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c.f0ca5602-bfd3-4774-837f-4543032d1702 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:26 devstack sudo[92052]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_lk1_hw17" returned: 0 in 0.485s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_lk1_hw17 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:26 devstack sudo[92060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c.f0ca5602-bfd3-4774-837f-4543032d1702 1G Sep 01 08:17:26 devstack sudo[92060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:26 devstack sudo[92063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_lk1_hw17 Sep 01 08:17:26 devstack sudo[92063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:27 devstack sudo[92063]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_lk1_hw17" returned: 1 in 0.373s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_lk1_hw17' failed. Not Retrying. {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 08:17:27 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ffd279-a34c-4ef5-b710-eb269dd3bec0]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:17:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_j29fnqspdevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:27 devstack sudo[92071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_j29fnqspdevstack@QuobyteHD Sep 01 08:17:27 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:27 devstack sudo[92060]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c.f0ca5602-bfd3-4774-837f-4543032d1702 1G" returned: 0 in 0.560s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c.f0ca5602-bfd3-4774-837f-4543032d1702 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:27 devstack sudo[92074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c.f0ca5602-bfd3-4774-837f-4543032d1702 Sep 01 08:17:27 devstack sudo[92074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:27 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:27 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:17:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] Flow 'volume_create_manager' (8a150b6b-da4f-4831-9d66-11e066c38a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:17:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fee048ed-4831-4049-aa2f-1834c2558e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_j29fnqspdevstack@QuobyteHD" returned: 0 in 0.486s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:27 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] 00f5a94d-dba5-4527-9ce8-7a00c3b29ced was qcow2, converting to qcow2 {{(pid=86893) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 08:17:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_j29fnqspdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bacb2011-cf8f-4541-adc0-0b633c7f366a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:27 devstack sudo[92074]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c.f0ca5602-bfd3-4774-837f-4543032d1702" returned: 0 in 0.381s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:27 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c.f0ca5602-bfd3-4774-837f-4543032d1702 is being set with open permissions: ugo+rw Sep 01 08:17:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c.f0ca5602-bfd3-4774-837f-4543032d1702 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:27 devstack sudo[92082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_j29fnqspdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bacb2011-cf8f-4541-adc0-0b633c7f366a Sep 01 08:17:27 devstack sudo[92082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fee048ed-4831-4049-aa2f-1834c2558e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-510616582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d806225f-c739-482d-931c-03d5c4e152c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13384eca16994a00851b0aa0d3136691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:17:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:17:27Z,use_quota=True,user_id='0dbdd1ffc2974f9ea68545b85ccd4718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:27 devstack sudo[92083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c.f0ca5602-bfd3-4774-837f-4543032d1702 Sep 01 08:17:27 devstack sudo[92083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e671cde-a59d-4a69-9222-8dfe17bb4333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e671cde-a59d-4a69-9222-8dfe17bb4333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ffee78-2ce7-4103-9918-91437ca57403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ffee78-2ce7-4103-9918-91437ca57403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd806225f-c739-482d-931c-03d5c4e152c7', 'volume_name': 'volume-d806225f-c739-482d-931c-03d5c4e152c7', 'volume_size': 2}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (077f1f57-4f2c-4306-a40f-df5425b92fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (077f1f57-4f2c-4306-a40f-df5425b92fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b8ba961-b25c-4832-84a0-5943dbe604ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:27 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] Volume d806225f-c739-482d-931c-03d5c4e152c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d806225f-c739-482d-931c-03d5c4e152c7', 'volume_size': 2} Sep 01 08:17:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:27 devstack sudo[92083]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c.f0ca5602-bfd3-4774-837f-4543032d1702" returned: 0 in 0.297s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:27 devstack sudo[92090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c.info Sep 01 08:17:27 devstack sudo[92090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:28 devstack sudo[92090]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c.info" returned: 0 in 0.281s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:28 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c.info is being set with open permissions: ugo+rw Sep 01 08:17:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:28 devstack sudo[92095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c.info Sep 01 08:17:28 devstack sudo[92095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:28 devstack sudo[92095]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c.info" returned: 0 in 0.317s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Acquiring lock "cinder-quobyte-c313394e-51d7-47dc-bb34-72779ee2fd94" by "_copy_volume_from_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:17:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Lock "cinder-quobyte-c313394e-51d7-47dc-bb34-72779ee2fd94" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:17:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] snapshot: f0ca5602-bfd3-4774-837f-4543032d1702, volume: c313394e-51d7-47dc-bb34-72779ee2fd94, {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 08:17:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:17:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:17:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:28 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48ea32a-ca23-4c2f-80d5-c1a6ebdb40c6]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:17:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c.f0ca5602-bfd3-4774-837f-4543032d1702 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:28 devstack sudo[92098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c.f0ca5602-bfd3-4774-837f-4543032d1702 Sep 01 08:17:28 devstack sudo[92098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:29 devstack sudo[92098]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c.f0ca5602-bfd3-4774-837f-4543032d1702" returned: 0 in 0.513s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:17:29 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb50c50-7ee5-4b88-9918-0c07c6de31f9]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:17:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:29 devstack sudo[92103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c Sep 01 08:17:29 devstack sudo[92103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:29 devstack sudo[92082]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_j29fnqspdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bacb2011-cf8f-4541-adc0-0b633c7f366a" returned: 0 in 1.767s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:29 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_j29fnqspdevstack@QuobyteHD, size 112.00 MB, duration 1.77 sec, destination /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bacb2011-cf8f-4541-adc0-0b633c7f366a {{(pid=86893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 08:17:29 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Converted 112.00 MB image at 63.22 MB/s Sep 01 08:17:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bacb2011-cf8f-4541-adc0-0b633c7f366a 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:29 devstack sudo[92105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bacb2011-cf8f-4541-adc0-0b633c7f366a 1G Sep 01 08:17:29 devstack sudo[92105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:29 devstack sudo[92103]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c" returned: 0 in 0.459s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 08:17:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Creating direct copy from snapshot {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 08:17:29 devstack cinder-volume[86893]: DEBUG cinder.utils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Path /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c313394e-51d7-47dc-bb34-72779ee2fd94 not found in is_blk_device check {{(pid=86893) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 08:17:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c313394e-51d7-47dc-bb34-72779ee2fd94 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:29 devstack sudo[92112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c313394e-51d7-47dc-bb34-72779ee2fd94 Sep 01 08:17:29 devstack sudo[92112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:29 devstack sudo[92105]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bacb2011-cf8f-4541-adc0-0b633c7f366a 1G" returned: 0 in 0.375s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:29 devstack cinder-volume[86893]: DEBUG cinder.volume.volume_utils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Downloaded image 00f5a94d-dba5-4527-9ce8-7a00c3b29ced ((None, [{'url': 'file:///opt/stack/data/glance/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'metadata': {}}])) to volume bacb2011-cf8f-4541-adc0-0b633c7f366a successfully. {{(pid=86893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 08:17:29 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Temporary image 00f5a94d-dba5-4527-9ce8-7a00c3b29ced for user ebc79b04914d450db588437c83cca103 is deleted. {{(pid=86893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 08:17:29 devstack cinder-volume[86893]: DEBUG cinder.volume.volume_utils [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Marking volume bacb2011-cf8f-4541-adc0-0b633c7f366a as bootable. {{(pid=86893) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 08:17:29 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Copying metadata from image 00f5a94d-dba5-4527-9ce8-7a00c3b29ced to bacb2011-cf8f-4541-adc0-0b633c7f366a. {{(pid=86893) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 08:17:29 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Creating volume glance metadata for volume bacb2011-cf8f-4541-adc0-0b633c7f366a backed by image 00f5a94d-dba5-4527-9ce8-7a00c3b29ced with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86893) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 08:17:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef71c63-533d-40cf-a3ac-34994c664033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bacb2011-cf8f-4541-adc0-0b633c7f366a', 'volume_size': 1, 'image_id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a80c3dd0151a4e4aacd690bfb315fb01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'created_at': datetime.datetime(2026, 9, 1, 6, 7, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 6, 7, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6364ec3b-a2c1-4769-95e2-f8b92ec9b5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:29 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Volume volume-bacb2011-cf8f-4541-adc0-0b633c7f366a (bacb2011-cf8f-4541-adc0-0b633c7f366a): created successfully Sep 01 08:17:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6364ec3b-a2c1-4769-95e2-f8b92ec9b5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Flow 'volume_create_manager' (612b4b7e-02ca-4898-85c8-38e7d50a985f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:17:29 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-a46c1687-0b1b-433c-af8c-61af6cdd28b9 tempest-ServerActionsTestOtherA-1037332526 None] Created volume successfully. Sep 01 08:17:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:17:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:17:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:17:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:31 devstack sudo[92139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:17:31 devstack sudo[92139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:31 devstack sudo[92139]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.375s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:31 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:17:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager._thread_info {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:17:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread count: 28 {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 08:17:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread info: [<_MainThread(MainThread, started 138934582050944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 08:17:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c313394e-51d7-47dc-bb34-72779ee2fd94" returned: 0 in 6.809s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:36 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Image conversion details: src /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c, size 1024.00 MB, duration 6.81 sec, destination /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c313394e-51d7-47dc-bb34-72779ee2fd94 {{(pid=86893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 08:17:36 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Converted 1024.00 MB image at 150.33 MB/s Sep 01 08:17:36 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c313394e-51d7-47dc-bb34-72779ee2fd94 is being set with open permissions: ugo+rw Sep 01 08:17:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c313394e-51d7-47dc-bb34-72779ee2fd94 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:36 devstack sudo[92149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c313394e-51d7-47dc-bb34-72779ee2fd94 Sep 01 08:17:36 devstack sudo[92149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:36 devstack sudo[92149]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c313394e-51d7-47dc-bb34-72779ee2fd94" returned: 0 in 0.334s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:36 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Lock "cinder-quobyte-c313394e-51d7-47dc-bb34-72779ee2fd94" released by "_copy_volume_from_snapshot" :: held 8.197s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:17:36 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Acquiring lock "cinder-quobyte-f0ca5602-bfd3-4774-837f-4543032d1702" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:17:36 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Lock "cinder-quobyte-f0ca5602-bfd3-4774-837f-4543032d1702" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:17:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Deleting offline snapshot f0ca5602-bfd3-4774-837f-4543032d1702 of volume 9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:17:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] snapshot_file for this snap is: volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c.f0ca5602-bfd3-4774-837f-4543032d1702 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:17:36 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[15242d9c-35e7-4f33-8799-af7a1c331894]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:17:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c.f0ca5602-bfd3-4774-837f-4543032d1702 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:37 devstack sudo[92153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c.f0ca5602-bfd3-4774-837f-4543032d1702 Sep 01 08:17:37 devstack sudo[92153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-6f396cd9-08cf-4a20-8b06-8f9fadeb477d req-a7fb93b8-bc84-45ac-87aa-be50e0bd3c20 tempest-ServerActionsTestOtherA-1037332526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:37 devstack sudo[92153]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c.f0ca5602-bfd3-4774-837f-4543032d1702" returned: 0 in 0.503s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:17:37 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f85aa13-3950-4c6c-9b1a-a03d971098fd]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:17:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:37 devstack sudo[92166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c Sep 01 08:17:37 devstack sudo[92166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:38 devstack sudo[92166]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c" returned: 0 in 0.720s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c.f0ca5602-bfd3-4774-837f-4543032d1702 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:38 devstack sudo[92171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c.f0ca5602-bfd3-4774-837f-4543032d1702 Sep 01 08:17:38 devstack sudo[92171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:38 devstack sudo[92171]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c.f0ca5602-bfd3-4774-837f-4543032d1702" returned: 0 in 0.371s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c.f0ca5602-bfd3-4774-837f-4543032d1702 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:38 devstack sudo[92178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c.f0ca5602-bfd3-4774-837f-4543032d1702 Sep 01 08:17:38 devstack sudo[92178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:38 devstack sudo[92178]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c.f0ca5602-bfd3-4774-837f-4543032d1702" returned: 0 in 0.303s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:38 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Lock "cinder-quobyte-f0ca5602-bfd3-4774-837f-4543032d1702" released by "_delete_snapshot" :: held 2.018s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:17:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.744s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.201s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-510616582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d806225f-c739-482d-931c-03d5c4e152c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13384eca16994a00851b0aa0d3136691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:17:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:17:27Z,use_quota=True,user_id='0dbdd1ffc2974f9ea68545b85ccd4718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:17:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] Creating volume d806225f-c739-482d-931c-03d5c4e152c7 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:17:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:17:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:17:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:17:38 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:17:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d806225f-c739-482d-931c-03d5c4e152c7 2147483648 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cbb05b-bd06-47a4-820f-3bd84497471a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c313394e-51d7-47dc-bb34-72779ee2fd94', 'volume_size': 2, 'source_volid': '9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c', 'source_volstatus': 'available'}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:38 devstack sudo[92181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d806225f-c739-482d-931c-03d5c4e152c7 2147483648 Sep 01 08:17:38 devstack sudo[92181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85a30efc-d49a-4e39-bcc8-f80cd8e2f362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:38 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Volume volume-c313394e-51d7-47dc-bb34-72779ee2fd94 (c313394e-51d7-47dc-bb34-72779ee2fd94): created successfully Sep 01 08:17:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85a30efc-d49a-4e39-bcc8-f80cd8e2f362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Flow 'volume_create_manager' (6ec27034-3f55-4e84-baee-8d122c30b0ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:17:38 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-bae53d5f-7c0d-4616-822a-c49ec65ea024 tempest-VolumesCloneTest-1123833027 None] Created volume successfully. Sep 01 08:17:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d3b29307-5ae8-4d0b-8a78-c06fc4780d4e tempest-VolumesCloneTest-1123833027 None] Acquiring lock "cinder-c313394e-51d7-47dc-bb34-72779ee2fd94-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:17:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d3b29307-5ae8-4d0b-8a78-c06fc4780d4e tempest-VolumesCloneTest-1123833027 None] Lock "cinder-c313394e-51d7-47dc-bb34-72779ee2fd94-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:17:39 devstack sudo[92181]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d806225f-c739-482d-931c-03d5c4e152c7 2147483648" returned: 0 in 0.618s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d3b29307-5ae8-4d0b-8a78-c06fc4780d4e tempest-VolumesCloneTest-1123833027 None] Acquiring lock "cinder-quobyte-c313394e-51d7-47dc-bb34-72779ee2fd94" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:17:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d806225f-c739-482d-931c-03d5c4e152c7 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d3b29307-5ae8-4d0b-8a78-c06fc4780d4e tempest-VolumesCloneTest-1123833027 None] Lock "cinder-quobyte-c313394e-51d7-47dc-bb34-72779ee2fd94" acquired by "delete_volume" :: waited 0.032s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:17:39 devstack sudo[92189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d806225f-c739-482d-931c-03d5c4e152c7 Sep 01 08:17:39 devstack sudo[92189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:39 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1b524c-a7d2-43b3-b218-9efc09a67a30]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:17:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d3b29307-5ae8-4d0b-8a78-c06fc4780d4e tempest-VolumesCloneTest-1123833027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c313394e-51d7-47dc-bb34-72779ee2fd94 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:39 devstack sudo[92191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c313394e-51d7-47dc-bb34-72779ee2fd94 Sep 01 08:17:39 devstack sudo[92191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:39 devstack sudo[92189]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d806225f-c739-482d-931c-03d5c4e152c7" returned: 0 in 0.255s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:17:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-6f396cd9-08cf-4a20-8b06-8f9fadeb477d req-a7fb93b8-bc84-45ac-87aa-be50e0bd3c20 tempest-ServerActionsTestOtherA-1037332526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.606s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-6f396cd9-08cf-4a20-8b06-8f9fadeb477d req-a7fb93b8-bc84-45ac-87aa-be50e0bd3c20 tempest-ServerActionsTestOtherA-1037332526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b8ba961-b25c-4832-84a0-5943dbe604ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d806225f-c739-482d-931c-03d5c4e152c7', 'volume_size': 2}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22b5f8fb-47db-4cf5-9e8c-f6177126834f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:39 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] Volume volume-d806225f-c739-482d-931c-03d5c4e152c7 (d806225f-c739-482d-931c-03d5c4e152c7): created successfully Sep 01 08:17:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22b5f8fb-47db-4cf5-9e8c-f6177126834f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] Flow 'volume_create_manager' (8a150b6b-da4f-4831-9d66-11e066c38a5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:17:39 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-3cde2449-4fab-4ea3-a3d5-b2b6792408dd tempest-VolumesCloneNegativeTest-1994186224 None] Created volume successfully. Sep 01 08:17:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-6f396cd9-08cf-4a20-8b06-8f9fadeb477d req-a7fb93b8-bc84-45ac-87aa-be50e0bd3c20 tempest-ServerActionsTestOtherA-1037332526 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049', 'name': 'volume-bacb2011-cf8f-4541-adc0-0b633c7f366a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b58dc31a-dbd3-4123-b001-cb597ce34555', 'enforce_multipath': True} {{(pid=86893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 08:17:39 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-6f396cd9-08cf-4a20-8b06-8f9fadeb477d req-a7fb93b8-bc84-45ac-87aa-be50e0bd3c20 tempest-ServerActionsTestOtherA-1037332526 None] attachment_update completed successfully. Sep 01 08:17:40 devstack sudo[92191]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d3b29307-5ae8-4d0b-8a78-c06fc4780d4e tempest-VolumesCloneTest-1123833027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c313394e-51d7-47dc-bb34-72779ee2fd94" returned: 0 in 0.446s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d3b29307-5ae8-4d0b-8a78-c06fc4780d4e tempest-VolumesCloneTest-1123833027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c313394e-51d7-47dc-bb34-72779ee2fd94 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:40 devstack sudo[92197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c313394e-51d7-47dc-bb34-72779ee2fd94 Sep 01 08:17:40 devstack sudo[92197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:40 devstack sudo[92197]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d3b29307-5ae8-4d0b-8a78-c06fc4780d4e tempest-VolumesCloneTest-1123833027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c313394e-51d7-47dc-bb34-72779ee2fd94" returned: 0 in 0.281s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d3b29307-5ae8-4d0b-8a78-c06fc4780d4e tempest-VolumesCloneTest-1123833027 None] Lock "cinder-quobyte-c313394e-51d7-47dc-bb34-72779ee2fd94" released by "delete_volume" :: held 0.777s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:17:40 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-d3b29307-5ae8-4d0b-8a78-c06fc4780d4e tempest-VolumesCloneTest-1123833027 None] Created reservations ['3e645086-64f8-4788-b4a3-5823cbcfdc02', '6dd9c33a-574c-4b33-b777-7ef208b2e195', 'add1d229-0e51-454a-a515-07c4b78fa581', 'b94ba420-bdbb-489a-a1d6-7aa18345e3d9'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:17:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d3b29307-5ae8-4d0b-8a78-c06fc4780d4e tempest-VolumesCloneTest-1123833027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d3b29307-5ae8-4d0b-8a78-c06fc4780d4e tempest-VolumesCloneTest-1123833027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:40 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d3b29307-5ae8-4d0b-8a78-c06fc4780d4e tempest-VolumesCloneTest-1123833027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:17:40 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d3b29307-5ae8-4d0b-8a78-c06fc4780d4e tempest-VolumesCloneTest-1123833027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:17:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d3b29307-5ae8-4d0b-8a78-c06fc4780d4e tempest-VolumesCloneTest-1123833027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d3b29307-5ae8-4d0b-8a78-c06fc4780d4e tempest-VolumesCloneTest-1123833027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:40 devstack sudo[92264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:17:40 devstack sudo[92264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e1686335-4193-45c5-9479-57860dc48325 tempest-VolumesCloneTest-1123833027 None] Acquiring lock "cinder-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:17:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e1686335-4193-45c5-9479-57860dc48325 tempest-VolumesCloneTest-1123833027 None] Lock "cinder-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:17:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e1686335-4193-45c5-9479-57860dc48325 tempest-VolumesCloneTest-1123833027 None] Acquiring lock "cinder-quobyte-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:17:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e1686335-4193-45c5-9479-57860dc48325 tempest-VolumesCloneTest-1123833027 None] Lock "cinder-quobyte-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c" acquired by "delete_volume" :: waited 0.035s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:17:40 devstack sudo[92264]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d3b29307-5ae8-4d0b-8a78-c06fc4780d4e tempest-VolumesCloneTest-1123833027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.485s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:40 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-d3b29307-5ae8-4d0b-8a78-c06fc4780d4e tempest-VolumesCloneTest-1123833027 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:17:40 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-d3b29307-5ae8-4d0b-8a78-c06fc4780d4e tempest-VolumesCloneTest-1123833027 None] Deleted volume successfully. Sep 01 08:17:40 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5bf109-870e-4f82-9ade-668116e729ff]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:17:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e1686335-4193-45c5-9479-57860dc48325 tempest-VolumesCloneTest-1123833027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:41 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d3b29307-5ae8-4d0b-8a78-c06fc4780d4e tempest-VolumesCloneTest-1123833027 None] Lock "cinder-c313394e-51d7-47dc-bb34-72779ee2fd94-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:17:41 devstack sudo[92604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c Sep 01 08:17:41 devstack sudo[92604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:41 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-78f0b72d-53e9-4391-beb9-c22722dc909d tempest-VolumesCloneNegativeTest-1994186224 None] Acquiring lock "cinder-d806225f-c739-482d-931c-03d5c4e152c7-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:17:41 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-78f0b72d-53e9-4391-beb9-c22722dc909d tempest-VolumesCloneNegativeTest-1994186224 None] Lock "cinder-d806225f-c739-482d-931c-03d5c4e152c7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:17:41 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-78f0b72d-53e9-4391-beb9-c22722dc909d tempest-VolumesCloneNegativeTest-1994186224 None] Acquiring lock "cinder-quobyte-d806225f-c739-482d-931c-03d5c4e152c7" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:17:41 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-78f0b72d-53e9-4391-beb9-c22722dc909d tempest-VolumesCloneNegativeTest-1994186224 None] Lock "cinder-quobyte-d806225f-c739-482d-931c-03d5c4e152c7" acquired by "delete_volume" :: waited 0.016s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:17:41 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[2371a770-d923-4aaa-8913-fb6ee4afdd43]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:17:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-78f0b72d-53e9-4391-beb9-c22722dc909d tempest-VolumesCloneNegativeTest-1994186224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d806225f-c739-482d-931c-03d5c4e152c7 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:41 devstack sudo[92604]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:41 devstack sudo[92624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d806225f-c739-482d-931c-03d5c4e152c7 Sep 01 08:17:41 devstack sudo[92624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e1686335-4193-45c5-9479-57860dc48325 tempest-VolumesCloneTest-1123833027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c" returned: 0 in 0.665s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e1686335-4193-45c5-9479-57860dc48325 tempest-VolumesCloneTest-1123833027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:41 devstack sudo[92631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c Sep 01 08:17:41 devstack sudo[92631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:41 devstack sudo[92631]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e1686335-4193-45c5-9479-57860dc48325 tempest-VolumesCloneTest-1123833027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c" returned: 0 in 0.277s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:41 devstack sudo[92624]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-78f0b72d-53e9-4391-beb9-c22722dc909d tempest-VolumesCloneNegativeTest-1994186224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d806225f-c739-482d-931c-03d5c4e152c7" returned: 0 in 0.494s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-78f0b72d-53e9-4391-beb9-c22722dc909d tempest-VolumesCloneNegativeTest-1994186224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d806225f-c739-482d-931c-03d5c4e152c7 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:41 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e1686335-4193-45c5-9479-57860dc48325 tempest-VolumesCloneTest-1123833027 None] Lock "cinder-quobyte-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c" released by "delete_volume" :: held 1.053s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:17:41 devstack sudo[92637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d806225f-c739-482d-931c-03d5c4e152c7 Sep 01 08:17:41 devstack sudo[92637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:42 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-e1686335-4193-45c5-9479-57860dc48325 tempest-VolumesCloneTest-1123833027 None] Created reservations ['0dcd4841-36ff-4754-97ef-bd367342d309', '5f5cb8d2-ed30-4469-bd19-e4868cc530e3', 'd43d46eb-6d3e-4b1f-9417-7b75a27ace89', '847349e0-9858-46f7-9cd7-902a7d9235a6'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:17:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e1686335-4193-45c5-9479-57860dc48325 tempest-VolumesCloneTest-1123833027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e1686335-4193-45c5-9479-57860dc48325 tempest-VolumesCloneTest-1123833027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e1686335-4193-45c5-9479-57860dc48325 tempest-VolumesCloneTest-1123833027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:17:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e1686335-4193-45c5-9479-57860dc48325 tempest-VolumesCloneTest-1123833027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:17:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e1686335-4193-45c5-9479-57860dc48325 tempest-VolumesCloneTest-1123833027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e1686335-4193-45c5-9479-57860dc48325 tempest-VolumesCloneTest-1123833027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:42 devstack sudo[92639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:17:42 devstack sudo[92639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:42 devstack sudo[92637]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-78f0b72d-53e9-4391-beb9-c22722dc909d tempest-VolumesCloneNegativeTest-1994186224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d806225f-c739-482d-931c-03d5c4e152c7" returned: 0 in 0.262s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-78f0b72d-53e9-4391-beb9-c22722dc909d tempest-VolumesCloneNegativeTest-1994186224 None] Lock "cinder-quobyte-d806225f-c739-482d-931c-03d5c4e152c7" released by "delete_volume" :: held 0.818s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:17:42 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-78f0b72d-53e9-4391-beb9-c22722dc909d tempest-VolumesCloneNegativeTest-1994186224 None] Created reservations ['e04585ff-109f-45a7-af2a-b23b654cc371', 'dc593895-8a8a-4f44-b3b1-12afe7f9f95f', '97deadcd-3753-4f74-8e3a-db89d5738439', 'fe27dac9-68a3-476c-a886-08cab092fc6b'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:17:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-78f0b72d-53e9-4391-beb9-c22722dc909d tempest-VolumesCloneNegativeTest-1994186224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-78f0b72d-53e9-4391-beb9-c22722dc909d tempest-VolumesCloneNegativeTest-1994186224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-78f0b72d-53e9-4391-beb9-c22722dc909d tempest-VolumesCloneNegativeTest-1994186224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:17:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-78f0b72d-53e9-4391-beb9-c22722dc909d tempest-VolumesCloneNegativeTest-1994186224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:17:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-78f0b72d-53e9-4391-beb9-c22722dc909d tempest-VolumesCloneNegativeTest-1994186224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-78f0b72d-53e9-4391-beb9-c22722dc909d tempest-VolumesCloneNegativeTest-1994186224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:42 devstack sudo[92639]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e1686335-4193-45c5-9479-57860dc48325 tempest-VolumesCloneTest-1123833027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.279s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:42 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-e1686335-4193-45c5-9479-57860dc48325 tempest-VolumesCloneTest-1123833027 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:17:42 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-e1686335-4193-45c5-9479-57860dc48325 tempest-VolumesCloneTest-1123833027 None] Deleted volume successfully. Sep 01 08:17:42 devstack sudo[92643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:17:42 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e1686335-4193-45c5-9479-57860dc48325 tempest-VolumesCloneTest-1123833027 None] Lock "cinder-9fcbcbf8-f0e8-49bb-a1d9-4a3c728a001c-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:17:42 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-78f0b72d-53e9-4391-beb9-c22722dc909d tempest-VolumesCloneNegativeTest-1994186224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.405s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:42 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-78f0b72d-53e9-4391-beb9-c22722dc909d tempest-VolumesCloneNegativeTest-1994186224 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:17:42 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-78f0b72d-53e9-4391-beb9-c22722dc909d tempest-VolumesCloneNegativeTest-1994186224 None] Deleted volume successfully. Sep 01 08:17:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-78f0b72d-53e9-4391-beb9-c22722dc909d tempest-VolumesCloneNegativeTest-1994186224 None] Lock "cinder-d806225f-c739-482d-931c-03d5c4e152c7-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:17:47 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:17:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] Flow 'volume_create_manager' (4f3b7d63-caee-48b4-ade0-f562762265ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:17:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (278837e8-acf6-414e-86b2-bd5267d357b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (278837e8-acf6-414e-86b2-bd5267d357b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1991833119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fec8a18a-223f-4e8f-92e3-d155be573957,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a93088012da54b55bfc9f51c42feb372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:17:47Z,use_quota=True,user_id='18e571a18a864826971fbb4ecc696ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70daf6fe-e1a6-433f-bf2f-73d83afe5d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70daf6fe-e1a6-433f-bf2f-73d83afe5d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbcd6d8c-4302-48c1-9566-ed44ae080198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbcd6d8c-4302-48c1-9566-ed44ae080198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fec8a18a-223f-4e8f-92e3-d155be573957', 'volume_name': 'volume-fec8a18a-223f-4e8f-92e3-d155be573957', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8679762c-375a-4ea9-838e-7637d561f100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8679762c-375a-4ea9-838e-7637d561f100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (003640ca-20d1-43a4-9d0a-c96fe1fc09ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:47 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] Volume fec8a18a-223f-4e8f-92e3-d155be573957: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fec8a18a-223f-4e8f-92e3-d155be573957', 'volume_size': 1} Sep 01 08:17:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1991833119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fec8a18a-223f-4e8f-92e3-d155be573957,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a93088012da54b55bfc9f51c42feb372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:17:47Z,use_quota=True,user_id='18e571a18a864826971fbb4ecc696ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:17:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] Creating volume fec8a18a-223f-4e8f-92e3-d155be573957 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:17:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:17:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:17:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:17:47 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:17:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fec8a18a-223f-4e8f-92e3-d155be573957 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:47 devstack sudo[92654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fec8a18a-223f-4e8f-92e3-d155be573957 1073741824 Sep 01 08:17:47 devstack sudo[92654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:48 devstack sudo[92654]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fec8a18a-223f-4e8f-92e3-d155be573957 1073741824" returned: 0 in 0.971s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fec8a18a-223f-4e8f-92e3-d155be573957 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:48 devstack sudo[92660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fec8a18a-223f-4e8f-92e3-d155be573957 Sep 01 08:17:48 devstack sudo[92660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:49 devstack sudo[92660]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fec8a18a-223f-4e8f-92e3-d155be573957" returned: 0 in 0.453s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:49 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:17:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (003640ca-20d1-43a4-9d0a-c96fe1fc09ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fec8a18a-223f-4e8f-92e3-d155be573957', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5c18bf4-0b1a-4c63-9bf2-a1468cdd27a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:49 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] Volume volume-fec8a18a-223f-4e8f-92e3-d155be573957 (fec8a18a-223f-4e8f-92e3-d155be573957): created successfully Sep 01 08:17:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5c18bf4-0b1a-4c63-9bf2-a1468cdd27a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] Flow 'volume_create_manager' (4f3b7d63-caee-48b4-ade0-f562762265ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:17:49 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-6261353f-28c9-47dc-8459-a5fe3581b8c4 tempest-VolumesGetTest-843812307 None] Created volume successfully. Sep 01 08:17:50 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:17:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] Flow 'volume_create_manager' (8db52785-22e2-40dc-b818-9068e4558a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:17:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d7f62d-dfe7-4db3-9199-20012477a7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d7f62d-dfe7-4db3-9199-20012477a7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:17:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-900991841',display_name='tempest-VolumesGetTest-Volume-831145514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7261741c-4b0d-4b81-9b11-cf0f317debb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a93088012da54b55bfc9f51c42feb372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:17:51Z,use_quota=True,user_id='18e571a18a864826971fbb4ecc696ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9261c278-eee0-4042-a13e-d305bbc08710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9261c278-eee0-4042-a13e-d305bbc08710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc08075b-602c-407d-9416-63bcadac0953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc08075b-602c-407d-9416-63bcadac0953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7261741c-4b0d-4b81-9b11-cf0f317debb7', 'volume_name': 'volume-7261741c-4b0d-4b81-9b11-cf0f317debb7', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd3dd7a-836b-4531-97e3-65e3b57bb776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd3dd7a-836b-4531-97e3-65e3b57bb776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f49365ae-665f-4eb4-9967-6f228383c6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:50 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] Volume 7261741c-4b0d-4b81-9b11-cf0f317debb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7261741c-4b0d-4b81-9b11-cf0f317debb7', 'volume_size': 1} Sep 01 08:17:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:50 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:17:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-900991841',display_name='tempest-VolumesGetTest-Volume-831145514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7261741c-4b0d-4b81-9b11-cf0f317debb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a93088012da54b55bfc9f51c42feb372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:17:51Z,use_quota=True,user_id='18e571a18a864826971fbb4ecc696ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:17:50 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] Creating volume 7261741c-4b0d-4b81-9b11-cf0f317debb7 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:17:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:50 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:17:50 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:17:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:50 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:17:50 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:17:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7261741c-4b0d-4b81-9b11-cf0f317debb7 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:50 devstack sudo[92666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7261741c-4b0d-4b81-9b11-cf0f317debb7 1073741824 Sep 01 08:17:50 devstack sudo[92666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:51 devstack sudo[92666]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7261741c-4b0d-4b81-9b11-cf0f317debb7 1073741824" returned: 0 in 0.643s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7261741c-4b0d-4b81-9b11-cf0f317debb7 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:51 devstack sudo[92672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7261741c-4b0d-4b81-9b11-cf0f317debb7 Sep 01 08:17:51 devstack sudo[92672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:51 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] Flow 'volume_create_manager' (531ad18f-851a-449f-aefa-010e75eacd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47912972-9a95-464c-8e7a-670932417833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47912972-9a95-464c-8e7a-670932417833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1521159798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46d6aae5-ecad-429d-ba28-407a4fce2c80,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='917cc1e6e22a4106a8b22991cbfea6fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:17:52Z,use_quota=True,user_id='c6de4e4b9ad64c13b6dd4e04010a326d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff74281-500a-48a6-a528-ff330e8a79a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff74281-500a-48a6-a528-ff330e8a79a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80684afc-f98b-4b3e-961d-a7c130231d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80684afc-f98b-4b3e-961d-a7c130231d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46d6aae5-ecad-429d-ba28-407a4fce2c80', 'volume_name': 'volume-46d6aae5-ecad-429d-ba28-407a4fce2c80', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3b9c2e9-85ff-4977-b8b0-22a5783c4bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3b9c2e9-85ff-4977-b8b0-22a5783c4bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (721dac80-fbe8-45bc-86cf-72444f12cf1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:52 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] Volume 46d6aae5-ecad-429d-ba28-407a4fce2c80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46d6aae5-ecad-429d-ba28-407a4fce2c80', 'volume_size': 1} Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:52 devstack sudo[92672]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7261741c-4b0d-4b81-9b11-cf0f317debb7" returned: 0 in 0.475s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.043s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1521159798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46d6aae5-ecad-429d-ba28-407a4fce2c80,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='917cc1e6e22a4106a8b22991cbfea6fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:17:52Z,use_quota=True,user_id='c6de4e4b9ad64c13b6dd4e04010a326d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] Creating volume 46d6aae5-ecad-429d-ba28-407a4fce2c80 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:17:52 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-46d6aae5-ecad-429d-ba28-407a4fce2c80 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f49365ae-665f-4eb4-9967-6f228383c6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7261741c-4b0d-4b81-9b11-cf0f317debb7', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ecd20b-0713-4bd1-be6e-136ce65f97f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:52 devstack sudo[92675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-46d6aae5-ecad-429d-ba28-407a4fce2c80 1073741824 Sep 01 08:17:52 devstack sudo[92675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:52 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] Volume volume-7261741c-4b0d-4b81-9b11-cf0f317debb7 (7261741c-4b0d-4b81-9b11-cf0f317debb7): created successfully Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ecd20b-0713-4bd1-be6e-136ce65f97f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] Flow 'volume_create_manager' (8db52785-22e2-40dc-b818-9068e4558a1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:17:52 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-a78dae9f-be00-41b7-8be5-1036cdee4a27 tempest-VolumesGetTest-843812307 None] Created volume successfully. Sep 01 08:17:52 devstack sudo[92675]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-46d6aae5-ecad-429d-ba28-407a4fce2c80 1073741824" returned: 0 in 0.495s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-46d6aae5-ecad-429d-ba28-407a4fce2c80 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:52 devstack sudo[92681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-46d6aae5-ecad-429d-ba28-407a4fce2c80 Sep 01 08:17:52 devstack sudo[92681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:52 devstack sudo[92681]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-46d6aae5-ecad-429d-ba28-407a4fce2c80" returned: 0 in 0.284s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:17:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (721dac80-fbe8-45bc-86cf-72444f12cf1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46d6aae5-ecad-429d-ba28-407a4fce2c80', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaec341b-cc15-47e3-9dc1-c0a75ab66415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:53 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] Volume volume-46d6aae5-ecad-429d-ba28-407a4fce2c80 (46d6aae5-ecad-429d-ba28-407a4fce2c80): created successfully Sep 01 08:17:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaec341b-cc15-47e3-9dc1-c0a75ab66415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] Flow 'volume_create_manager' (531ad18f-851a-449f-aefa-010e75eacd06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:17:53 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-c449fafc-41e1-42e5-9acc-59099a305e43 tempest-VolumesListTestJSON-823570032 None] Created volume successfully. Sep 01 08:17:53 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ad1552d5-6c7a-49be-bf03-4321906973d8 tempest-VolumesGetTest-843812307 None] Acquiring lock "cinder-7261741c-4b0d-4b81-9b11-cf0f317debb7-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:17:53 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ad1552d5-6c7a-49be-bf03-4321906973d8 tempest-VolumesGetTest-843812307 None] Lock "cinder-7261741c-4b0d-4b81-9b11-cf0f317debb7-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:17:53 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ad1552d5-6c7a-49be-bf03-4321906973d8 tempest-VolumesGetTest-843812307 None] Acquiring lock "cinder-quobyte-7261741c-4b0d-4b81-9b11-cf0f317debb7" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:17:53 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ad1552d5-6c7a-49be-bf03-4321906973d8 tempest-VolumesGetTest-843812307 None] Lock "cinder-quobyte-7261741c-4b0d-4b81-9b11-cf0f317debb7" acquired by "delete_volume" :: waited 0.026s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:17:53 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[33adb5a0-74ed-4cfa-a42a-b85c015a82bf]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:17:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ad1552d5-6c7a-49be-bf03-4321906973d8 tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7261741c-4b0d-4b81-9b11-cf0f317debb7 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:53 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-64ebe0cb-16a2-450f-8845-09fbb0fbb65f req-a11fb0f5-d3ba-4615-95df-b428d9c71dd4 tempest-ServerActionsTestOtherA-1037332526 None] Terminate volume connection completed successfully. Sep 01 08:17:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-64ebe0cb-16a2-450f-8845-09fbb0fbb65f req-a11fb0f5-d3ba-4615-95df-b428d9c71dd4 tempest-ServerActionsTestOtherA-1037332526 None] Deleting attachment b58dc31a-dbd3-4123-b001-cb597ce34555. {{(pid=86893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 08:17:53 devstack sudo[92729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7261741c-4b0d-4b81-9b11-cf0f317debb7 Sep 01 08:17:53 devstack sudo[92729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:53 devstack sudo[92729]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ad1552d5-6c7a-49be-bf03-4321906973d8 tempest-VolumesGetTest-843812307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7261741c-4b0d-4b81-9b11-cf0f317debb7" returned: 0 in 0.420s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ad1552d5-6c7a-49be-bf03-4321906973d8 tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7261741c-4b0d-4b81-9b11-cf0f317debb7 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:53 devstack sudo[92737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7261741c-4b0d-4b81-9b11-cf0f317debb7 Sep 01 08:17:53 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:54 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ad1552d5-6c7a-49be-bf03-4321906973d8 tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7261741c-4b0d-4b81-9b11-cf0f317debb7" returned: 0 in 0.315s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ad1552d5-6c7a-49be-bf03-4321906973d8 tempest-VolumesGetTest-843812307 None] Lock "cinder-quobyte-7261741c-4b0d-4b81-9b11-cf0f317debb7" released by "delete_volume" :: held 0.792s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-ad1552d5-6c7a-49be-bf03-4321906973d8 tempest-VolumesGetTest-843812307 None] Created reservations ['e52c6937-a858-437c-a70e-5b77f6316b59', 'd9529865-445e-44ee-b71a-38715248716a', '3611d6ba-165b-46d7-97d4-5316084b32da', 'abf79b72-4172-40a0-b8f7-ef5d93a99888'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ad1552d5-6c7a-49be-bf03-4321906973d8 tempest-VolumesGetTest-843812307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ad1552d5-6c7a-49be-bf03-4321906973d8 tempest-VolumesGetTest-843812307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ad1552d5-6c7a-49be-bf03-4321906973d8 tempest-VolumesGetTest-843812307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ad1552d5-6c7a-49be-bf03-4321906973d8 tempest-VolumesGetTest-843812307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ad1552d5-6c7a-49be-bf03-4321906973d8 tempest-VolumesGetTest-843812307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ad1552d5-6c7a-49be-bf03-4321906973d8 tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:54 devstack sudo[92741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:17:54 devstack sudo[92741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9292d6a5-efa8-498a-b028-fb24bfa91c17 tempest-VolumesGetTest-843812307 None] Acquiring lock "cinder-fec8a18a-223f-4e8f-92e3-d155be573957-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9292d6a5-efa8-498a-b028-fb24bfa91c17 tempest-VolumesGetTest-843812307 None] Lock "cinder-fec8a18a-223f-4e8f-92e3-d155be573957-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9292d6a5-efa8-498a-b028-fb24bfa91c17 tempest-VolumesGetTest-843812307 None] Acquiring lock "cinder-quobyte-fec8a18a-223f-4e8f-92e3-d155be573957" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9292d6a5-efa8-498a-b028-fb24bfa91c17 tempest-VolumesGetTest-843812307 None] Lock "cinder-quobyte-fec8a18a-223f-4e8f-92e3-d155be573957" acquired by "delete_volume" :: waited 0.024s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e32399-9c0d-42d3-b321-16f5da91f73c]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9292d6a5-efa8-498a-b028-fb24bfa91c17 tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fec8a18a-223f-4e8f-92e3-d155be573957 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:54 devstack sudo[92741]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ad1552d5-6c7a-49be-bf03-4321906973d8 tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.567s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-ad1552d5-6c7a-49be-bf03-4321906973d8 tempest-VolumesGetTest-843812307 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:17:54 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-ad1552d5-6c7a-49be-bf03-4321906973d8 tempest-VolumesGetTest-843812307 None] Deleted volume successfully. Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] Flow 'volume_create_manager' (6bf72b50-03e3-4d67-bdf9-eb673788f7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab93765-4f34-4fca-aa2f-195b7cc83d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab93765-4f34-4fca-aa2f-195b7cc83d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1224182476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d75f2272-39af-4f45-87b8-115a5c631bed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='917cc1e6e22a4106a8b22991cbfea6fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:17:55Z,use_quota=True,user_id='c6de4e4b9ad64c13b6dd4e04010a326d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (232323d4-4f3c-4712-b7a4-f3a6f1a1b6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (232323d4-4f3c-4712-b7a4-f3a6f1a1b6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (717c1bfd-8a47-4287-b320-0ad3d392c1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (717c1bfd-8a47-4287-b320-0ad3d392c1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd75f2272-39af-4f45-87b8-115a5c631bed', 'volume_name': 'volume-d75f2272-39af-4f45-87b8-115a5c631bed', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eebfe018-95f6-4df0-b6bf-26d7c773d85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eebfe018-95f6-4df0-b6bf-26d7c773d85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (594026a5-78e3-4cf9-85c6-56cca9345aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:54 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] Volume d75f2272-39af-4f45-87b8-115a5c631bed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d75f2272-39af-4f45-87b8-115a5c631bed', 'volume_size': 1} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1224182476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d75f2272-39af-4f45-87b8-115a5c631bed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='917cc1e6e22a4106a8b22991cbfea6fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:17:55Z,use_quota=True,user_id='c6de4e4b9ad64c13b6dd4e04010a326d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] Creating volume d75f2272-39af-4f45-87b8-115a5c631bed {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:17:54 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:17:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d75f2272-39af-4f45-87b8-115a5c631bed 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:54 devstack sudo[92744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fec8a18a-223f-4e8f-92e3-d155be573957 Sep 01 08:17:54 devstack sudo[92744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ad1552d5-6c7a-49be-bf03-4321906973d8 tempest-VolumesGetTest-843812307 None] Lock "cinder-7261741c-4b0d-4b81-9b11-cf0f317debb7-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:17:55 devstack sudo[92746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d75f2272-39af-4f45-87b8-115a5c631bed 1073741824 Sep 01 08:17:55 devstack sudo[92746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:55 devstack sudo[92744]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9292d6a5-efa8-498a-b028-fb24bfa91c17 tempest-VolumesGetTest-843812307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fec8a18a-223f-4e8f-92e3-d155be573957" returned: 0 in 0.441s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9292d6a5-efa8-498a-b028-fb24bfa91c17 tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fec8a18a-223f-4e8f-92e3-d155be573957 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:55 devstack sudo[92757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fec8a18a-223f-4e8f-92e3-d155be573957 Sep 01 08:17:55 devstack sudo[92757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:55 devstack sudo[92746]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d75f2272-39af-4f45-87b8-115a5c631bed 1073741824" returned: 0 in 0.472s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d75f2272-39af-4f45-87b8-115a5c631bed {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-64ebe0cb-16a2-450f-8845-09fbb0fbb65f req-de4d7629-fac6-4125-a0be-5ee9e956b84c tempest-ServerActionsTestOtherA-1037332526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:55 devstack sudo[92766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d75f2272-39af-4f45-87b8-115a5c631bed Sep 01 08:17:55 devstack sudo[92766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:55 devstack sudo[92757]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9292d6a5-efa8-498a-b028-fb24bfa91c17 tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fec8a18a-223f-4e8f-92e3-d155be573957" returned: 0 in 0.276s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9292d6a5-efa8-498a-b028-fb24bfa91c17 tempest-VolumesGetTest-843812307 None] Lock "cinder-quobyte-fec8a18a-223f-4e8f-92e3-d155be573957" released by "delete_volume" :: held 0.777s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:17:55 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-9292d6a5-efa8-498a-b028-fb24bfa91c17 tempest-VolumesGetTest-843812307 None] Created reservations ['d1c1917f-6c64-44d8-bdcb-be62fd00c9c4', '5802afe1-cc15-4ddf-b0be-a3443a6d14ad', '59de97b7-b490-493f-ba3c-7d7b1c866db1', 'a6f65dad-d000-45bc-a34a-617134824424'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:17:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9292d6a5-efa8-498a-b028-fb24bfa91c17 tempest-VolumesGetTest-843812307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9292d6a5-efa8-498a-b028-fb24bfa91c17 tempest-VolumesGetTest-843812307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:55 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-9292d6a5-efa8-498a-b028-fb24bfa91c17 tempest-VolumesGetTest-843812307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:17:55 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-9292d6a5-efa8-498a-b028-fb24bfa91c17 tempest-VolumesGetTest-843812307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:17:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9292d6a5-efa8-498a-b028-fb24bfa91c17 tempest-VolumesGetTest-843812307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9292d6a5-efa8-498a-b028-fb24bfa91c17 tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:55 devstack sudo[92768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:17:55 devstack sudo[92768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:55 devstack sudo[92766]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d75f2272-39af-4f45-87b8-115a5c631bed" returned: 0 in 0.248s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:55 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:17:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-64ebe0cb-16a2-450f-8845-09fbb0fbb65f req-de4d7629-fac6-4125-a0be-5ee9e956b84c tempest-ServerActionsTestOtherA-1037332526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.235s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-64ebe0cb-16a2-450f-8845-09fbb0fbb65f req-de4d7629-fac6-4125-a0be-5ee9e956b84c tempest-ServerActionsTestOtherA-1037332526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (594026a5-78e3-4cf9-85c6-56cca9345aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d75f2272-39af-4f45-87b8-115a5c631bed', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e3eb59-f2c9-4b28-8d94-60f704abcbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:55 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] Volume volume-d75f2272-39af-4f45-87b8-115a5c631bed (d75f2272-39af-4f45-87b8-115a5c631bed): created successfully Sep 01 08:17:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e3eb59-f2c9-4b28-8d94-60f704abcbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] Flow 'volume_create_manager' (6bf72b50-03e3-4d67-bdf9-eb673788f7fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:17:55 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-c92e274f-390b-4113-bd00-4d37993704a8 tempest-VolumesListTestJSON-823570032 None] Created volume successfully. Sep 01 08:17:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-64ebe0cb-16a2-450f-8845-09fbb0fbb65f req-de4d7629-fac6-4125-a0be-5ee9e956b84c tempest-ServerActionsTestOtherA-1037332526 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049', 'name': 'volume-bacb2011-cf8f-4541-adc0-0b633c7f366a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '163042b2-d5b1-4c3b-aa43-8bbe519cb416', 'enforce_multipath': True} {{(pid=86893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 08:17:55 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-64ebe0cb-16a2-450f-8845-09fbb0fbb65f req-de4d7629-fac6-4125-a0be-5ee9e956b84c tempest-ServerActionsTestOtherA-1037332526 None] attachment_update completed successfully. Sep 01 08:17:55 devstack sudo[92768]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9292d6a5-efa8-498a-b028-fb24bfa91c17 tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.295s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:55 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-9292d6a5-efa8-498a-b028-fb24bfa91c17 tempest-VolumesGetTest-843812307 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:17:55 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-9292d6a5-efa8-498a-b028-fb24bfa91c17 tempest-VolumesGetTest-843812307 None] Deleted volume successfully. Sep 01 08:17:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9292d6a5-efa8-498a-b028-fb24bfa91c17 tempest-VolumesGetTest-843812307 None] Lock "cinder-fec8a18a-223f-4e8f-92e3-d155be573957-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:17:56 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:17:56 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] Flow 'volume_create_manager' (1aab8857-0b11-4bc6-8adb-df14f37df558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:17:56 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b3c21cb-8e5f-4974-897d-d3655cc1faaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:56 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b3c21cb-8e5f-4974-897d-d3655cc1faaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-108340366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09cd98af-cf69-4478-9140-bd2c6c3cf8a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a93088012da54b55bfc9f51c42feb372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:17:56Z,use_quota=True,user_id='18e571a18a864826971fbb4ecc696ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:56 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71245cc2-8bcf-45ea-9eaf-3afcea55ed61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:56 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71245cc2-8bcf-45ea-9eaf-3afcea55ed61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:56 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034e9961-b8a8-4e63-9601-21fc9925826f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:56 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034e9961-b8a8-4e63-9601-21fc9925826f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09cd98af-cf69-4478-9140-bd2c6c3cf8a1', 'volume_name': 'volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:56 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58337f46-2db3-458c-a176-c7911428b7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:56 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58337f46-2db3-458c-a176-c7911428b7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:56 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb1a616e-1f70-43d3-a0dd-2500ee97bfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:56 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] Volume 09cd98af-cf69-4478-9140-bd2c6c3cf8a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1', 'volume_size': 1} Sep 01 08:17:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:56 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-108340366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09cd98af-cf69-4478-9140-bd2c6c3cf8a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a93088012da54b55bfc9f51c42feb372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:17:56Z,use_quota=True,user_id='18e571a18a864826971fbb4ecc696ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:17:56 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] Creating volume 09cd98af-cf69-4478-9140-bd2c6c3cf8a1 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:17:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:56 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:17:56 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:17:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:56 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:17:56 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:17:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:56 devstack sudo[92843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1 1073741824 Sep 01 08:17:56 devstack sudo[92843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:57 devstack sudo[92843]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1 1073741824" returned: 0 in 0.611s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:57 devstack sudo[93197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1 Sep 01 08:17:57 devstack sudo[93197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:57 devstack sudo[93197]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1" returned: 0 in 0.373s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:17:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb1a616e-1f70-43d3-a0dd-2500ee97bfaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0428929f-cb70-41d5-8bc8-194183b9dde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:57 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] Volume volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1 (09cd98af-cf69-4478-9140-bd2c6c3cf8a1): created successfully Sep 01 08:17:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0428929f-cb70-41d5-8bc8-194183b9dde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] Flow 'volume_create_manager' (1aab8857-0b11-4bc6-8adb-df14f37df558) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:17:57 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-e2e0cd0c-93df-4f6d-94a5-653a87b1f208 tempest-VolumesGetTest-843812307 None] Created volume successfully. Sep 01 08:17:57 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:17:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] Flow 'volume_create_manager' (b230fe72-62ba-4f4e-bfaa-881126d98d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:17:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528da5e2-6886-46e4-adf3-13a9fa6eefa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528da5e2-6886-46e4-adf3-13a9fa6eefa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1257548652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faaf5be4-8260-4169-bd8c-a12277580ad1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='917cc1e6e22a4106a8b22991cbfea6fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:17:58Z,use_quota=True,user_id='c6de4e4b9ad64c13b6dd4e04010a326d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8418aaeb-df14-4bf1-971f-a29617d3adde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8418aaeb-df14-4bf1-971f-a29617d3adde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07312439-9fe9-4fdf-a23f-12111748ed37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07312439-9fe9-4fdf-a23f-12111748ed37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faaf5be4-8260-4169-bd8c-a12277580ad1', 'volume_name': 'volume-faaf5be4-8260-4169-bd8c-a12277580ad1', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3247ee0-daa8-4b2c-8d66-7179d931cda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3247ee0-daa8-4b2c-8d66-7179d931cda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f103533-f822-487c-8a70-4fbf13dcabe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:57 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] Volume faaf5be4-8260-4169-bd8c-a12277580ad1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faaf5be4-8260-4169-bd8c-a12277580ad1', 'volume_size': 1} Sep 01 08:17:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1257548652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faaf5be4-8260-4169-bd8c-a12277580ad1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='917cc1e6e22a4106a8b22991cbfea6fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:17:58Z,use_quota=True,user_id='c6de4e4b9ad64c13b6dd4e04010a326d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:17:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] Creating volume faaf5be4-8260-4169-bd8c-a12277580ad1 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:17:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:17:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:17:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:17:57 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:17:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-faaf5be4-8260-4169-bd8c-a12277580ad1 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:57 devstack sudo[93202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-faaf5be4-8260-4169-bd8c-a12277580ad1 1073741824 Sep 01 08:17:57 devstack sudo[93202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:58 devstack sudo[93202]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-faaf5be4-8260-4169-bd8c-a12277580ad1 1073741824" returned: 0 in 0.445s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-faaf5be4-8260-4169-bd8c-a12277580ad1 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:58 devstack sudo[93211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-faaf5be4-8260-4169-bd8c-a12277580ad1 Sep 01 08:17:58 devstack sudo[93211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:58 devstack sudo[93211]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-faaf5be4-8260-4169-bd8c-a12277580ad1" returned: 0 in 0.284s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:17:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:17:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f103533-f822-487c-8a70-4fbf13dcabe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faaf5be4-8260-4169-bd8c-a12277580ad1', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb3f328-1c77-4810-91f4-71768157f935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:58 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] Volume volume-faaf5be4-8260-4169-bd8c-a12277580ad1 (faaf5be4-8260-4169-bd8c-a12277580ad1): created successfully Sep 01 08:17:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb3f328-1c77-4810-91f4-71768157f935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] Flow 'volume_create_manager' (b230fe72-62ba-4f4e-bfaa-881126d98d8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:17:58 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-82a4a215-e491-4627-989a-435fff06a47b tempest-VolumesListTestJSON-823570032 None] Created volume successfully. Sep 01 08:17:59 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:17:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Flow 'volume_create_manager' (54c85ad2-b1b1-4416-aeaf-e8802f26830a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:17:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ad97bd1-9b6b-4117-83ab-cb44a6a742a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ad97bd1-9b6b-4117-83ab-cb44a6a742a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1994053583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9742bbc8-a640-4123-8f23-787520376ba0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a93088012da54b55bfc9f51c42feb372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=09cd98af-cf69-4478-9140-bd2c6c3cf8a1,status='creating',terminated_at=None,updated_at=2026-09-01T06:17:59Z,use_quota=True,user_id='18e571a18a864826971fbb4ecc696ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f8e577a-22a6-4922-9358-64101f9cee31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f8e577a-22a6-4922-9358-64101f9cee31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277fa4c0-f8fd-4c74-9119-b77bce31018c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277fa4c0-f8fd-4c74-9119-b77bce31018c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9742bbc8-a640-4123-8f23-787520376ba0', 'volume_name': 'volume-9742bbc8-a640-4123-8f23-787520376ba0', 'volume_size': 1, 'source_volid': '09cd98af-cf69-4478-9140-bd2c6c3cf8a1', 'source_volstatus': 'available'}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30fac2e8-9b4a-49d6-97f2-01ff936088d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30fac2e8-9b4a-49d6-97f2-01ff936088d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:17:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caec9277-206c-48a0-89f2-cbecab24a118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:17:59 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Volume 9742bbc8-a640-4123-8f23-787520376ba0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9742bbc8-a640-4123-8f23-787520376ba0', 'volume_size': 1, 'source_volid': '09cd98af-cf69-4478-9140-bd2c6c3cf8a1', 'source_volstatus': 'available'} Sep 01 08:17:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:17:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:17:59 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Cloning volume 09cd98af-cf69-4478-9140-bd2c6c3cf8a1 to volume 9742bbc8-a640-4123-8f23-787520376ba0 Sep 01 08:17:59 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Creating offline snapshot 4b48e104-961c-4473-ad6a-0b07ff1415e8 of volume 09cd98af-cf69-4478-9140-bd2c6c3cf8a1 {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:17:59 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c32edf-7445-4419-ad23-23febecd5bb7]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:17:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:59 devstack sudo[93215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1 Sep 01 08:17:59 devstack sudo[93215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:17:59 devstack sudo[93215]: pam_unix(sudo:session): session closed for user root Sep 01 08:17:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1" returned: 0 in 0.504s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:17:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1.4b48e104-961c-4473-ad6a-0b07ff1415e8 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:17:59 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1.4b48e104-961c-4473-ad6a-0b07ff1415e8 1G Sep 01 08:17:59 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:00 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1.4b48e104-961c-4473-ad6a-0b07ff1415e8 1G" returned: 0 in 0.731s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1.4b48e104-961c-4473-ad6a-0b07ff1415e8 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:00 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1.4b48e104-961c-4473-ad6a-0b07ff1415e8 Sep 01 08:18:00 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:01 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1.4b48e104-961c-4473-ad6a-0b07ff1415e8" returned: 0 in 0.526s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:01 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1.4b48e104-961c-4473-ad6a-0b07ff1415e8 is being set with open permissions: ugo+rw Sep 01 08:18:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1.4b48e104-961c-4473-ad6a-0b07ff1415e8 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:01 devstack sudo[93257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1.4b48e104-961c-4473-ad6a-0b07ff1415e8 Sep 01 08:18:01 devstack sudo[93257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:01 devstack sudo[93257]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1.4b48e104-961c-4473-ad6a-0b07ff1415e8" returned: 0 in 0.488s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:01 devstack sudo[93270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1.info Sep 01 08:18:01 devstack sudo[93270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:02 devstack sudo[93270]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1.info" returned: 0 in 0.509s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:02 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1.info is being set with open permissions: ugo+rw Sep 01 08:18:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:02 devstack sudo[93275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1.info Sep 01 08:18:02 devstack sudo[93275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:02 devstack sudo[93275]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1.info" returned: 0 in 0.487s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:02 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Acquiring lock "cinder-quobyte-9742bbc8-a640-4123-8f23-787520376ba0" by "_copy_volume_from_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:02 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Lock "cinder-quobyte-9742bbc8-a640-4123-8f23-787520376ba0" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:02 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] snapshot: 4b48e104-961c-4473-ad6a-0b07ff1415e8, volume: 9742bbc8-a640-4123-8f23-787520376ba0, {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 08:18:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:02 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:18:02 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:18:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:02 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec91265b-f428-456f-a120-843f3bdea08b]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:18:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1.4b48e104-961c-4473-ad6a-0b07ff1415e8 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:03 devstack sudo[93283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1.4b48e104-961c-4473-ad6a-0b07ff1415e8 Sep 01 08:18:03 devstack sudo[93283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:03 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-811310c6-4c40-4459-942a-56a4e8463e8a tempest-VolumesListTestJSON-823570032 None] Acquiring lock "cinder-faaf5be4-8260-4169-bd8c-a12277580ad1-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:03 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-811310c6-4c40-4459-942a-56a4e8463e8a tempest-VolumesListTestJSON-823570032 None] Lock "cinder-faaf5be4-8260-4169-bd8c-a12277580ad1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:03 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-811310c6-4c40-4459-942a-56a4e8463e8a tempest-VolumesListTestJSON-823570032 None] Acquiring lock "cinder-quobyte-faaf5be4-8260-4169-bd8c-a12277580ad1" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:03 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-811310c6-4c40-4459-942a-56a4e8463e8a tempest-VolumesListTestJSON-823570032 None] Lock "cinder-quobyte-faaf5be4-8260-4169-bd8c-a12277580ad1" acquired by "delete_volume" :: waited 0.059s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:03 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3c40a8-50f7-4e2e-a5ed-93aa797c9db2]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:18:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-811310c6-4c40-4459-942a-56a4e8463e8a tempest-VolumesListTestJSON-823570032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-faaf5be4-8260-4169-bd8c-a12277580ad1 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:03 devstack sudo[93283]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1.4b48e104-961c-4473-ad6a-0b07ff1415e8" returned: 0 in 0.849s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:03 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:18:03 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae811ce-1426-4e1d-987b-dc581e5dbe94]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:18:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:03 devstack sudo[93307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-faaf5be4-8260-4169-bd8c-a12277580ad1 Sep 01 08:18:03 devstack sudo[93307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:03 devstack sudo[93309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1 Sep 01 08:18:03 devstack sudo[93309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:04 devstack sudo[93307]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-811310c6-4c40-4459-942a-56a4e8463e8a tempest-VolumesListTestJSON-823570032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-faaf5be4-8260-4169-bd8c-a12277580ad1" returned: 0 in 0.556s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-811310c6-4c40-4459-942a-56a4e8463e8a tempest-VolumesListTestJSON-823570032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-faaf5be4-8260-4169-bd8c-a12277580ad1 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:04 devstack sudo[93316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-faaf5be4-8260-4169-bd8c-a12277580ad1 Sep 01 08:18:04 devstack sudo[93316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:04 devstack sudo[93309]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1" returned: 0 in 0.770s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:04 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1 {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 08:18:04 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Creating direct copy from snapshot {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 08:18:04 devstack cinder-volume[86893]: DEBUG cinder.utils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Path /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9742bbc8-a640-4123-8f23-787520376ba0 not found in is_blk_device check {{(pid=86893) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 08:18:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9742bbc8-a640-4123-8f23-787520376ba0 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:04 devstack sudo[93322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9742bbc8-a640-4123-8f23-787520376ba0 Sep 01 08:18:04 devstack sudo[93322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:04 devstack sudo[93316]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-811310c6-4c40-4459-942a-56a4e8463e8a tempest-VolumesListTestJSON-823570032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-faaf5be4-8260-4169-bd8c-a12277580ad1" returned: 0 in 0.680s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:04 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-811310c6-4c40-4459-942a-56a4e8463e8a tempest-VolumesListTestJSON-823570032 None] Lock "cinder-quobyte-faaf5be4-8260-4169-bd8c-a12277580ad1" released by "delete_volume" :: held 1.302s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:04 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-811310c6-4c40-4459-942a-56a4e8463e8a tempest-VolumesListTestJSON-823570032 None] Created reservations ['0f883b89-c472-4112-addd-ac0ebf2c1a67', '82564154-2ff7-49a2-851d-774928144657', 'f816af4e-04b7-4c1e-ad1a-e628ac805219', '6a244cb2-3a2d-4a7d-833e-dfebe8e2374e'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:18:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-811310c6-4c40-4459-942a-56a4e8463e8a tempest-VolumesListTestJSON-823570032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-811310c6-4c40-4459-942a-56a4e8463e8a tempest-VolumesListTestJSON-823570032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:05 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-811310c6-4c40-4459-942a-56a4e8463e8a tempest-VolumesListTestJSON-823570032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:18:05 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-811310c6-4c40-4459-942a-56a4e8463e8a tempest-VolumesListTestJSON-823570032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:18:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-811310c6-4c40-4459-942a-56a4e8463e8a tempest-VolumesListTestJSON-823570032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-811310c6-4c40-4459-942a-56a4e8463e8a tempest-VolumesListTestJSON-823570032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:05 devstack sudo[93330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:18:05 devstack sudo[93330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:05 devstack sudo[93330]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-811310c6-4c40-4459-942a-56a4e8463e8a tempest-VolumesListTestJSON-823570032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.390s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:05 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-811310c6-4c40-4459-942a-56a4e8463e8a tempest-VolumesListTestJSON-823570032 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:18:05 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-811310c6-4c40-4459-942a-56a4e8463e8a tempest-VolumesListTestJSON-823570032 None] Deleted volume successfully. Sep 01 08:18:05 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-811310c6-4c40-4459-942a-56a4e8463e8a tempest-VolumesListTestJSON-823570032 None] Lock "cinder-faaf5be4-8260-4169-bd8c-a12277580ad1-delete_volume" released by "delete_volume" :: held 2.185s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:06 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-5e1bd11b-27b3-4591-b9a9-179305d034a2 tempest-VolumesListTestJSON-823570032 None] Acquiring lock "cinder-d75f2272-39af-4f45-87b8-115a5c631bed-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:06 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-5e1bd11b-27b3-4591-b9a9-179305d034a2 tempest-VolumesListTestJSON-823570032 None] Lock "cinder-d75f2272-39af-4f45-87b8-115a5c631bed-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:06 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-5e1bd11b-27b3-4591-b9a9-179305d034a2 tempest-VolumesListTestJSON-823570032 None] Acquiring lock "cinder-quobyte-d75f2272-39af-4f45-87b8-115a5c631bed" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:06 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-5e1bd11b-27b3-4591-b9a9-179305d034a2 tempest-VolumesListTestJSON-823570032 None] Lock "cinder-quobyte-d75f2272-39af-4f45-87b8-115a5c631bed" acquired by "delete_volume" :: waited 0.036s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:06 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[7281cbc2-81d9-4c58-a474-e04f54310c9c]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:18:06 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5e1bd11b-27b3-4591-b9a9-179305d034a2 tempest-VolumesListTestJSON-823570032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d75f2272-39af-4f45-87b8-115a5c631bed {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:06 devstack sudo[93340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d75f2272-39af-4f45-87b8-115a5c631bed Sep 01 08:18:06 devstack sudo[93340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:07 devstack sudo[93340]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5e1bd11b-27b3-4591-b9a9-179305d034a2 tempest-VolumesListTestJSON-823570032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d75f2272-39af-4f45-87b8-115a5c631bed" returned: 0 in 0.991s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5e1bd11b-27b3-4591-b9a9-179305d034a2 tempest-VolumesListTestJSON-823570032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d75f2272-39af-4f45-87b8-115a5c631bed {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:07 devstack sudo[93347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d75f2272-39af-4f45-87b8-115a5c631bed Sep 01 08:18:07 devstack sudo[93347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:08 devstack sudo[93347]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5e1bd11b-27b3-4591-b9a9-179305d034a2 tempest-VolumesListTestJSON-823570032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d75f2272-39af-4f45-87b8-115a5c631bed" returned: 0 in 0.731s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:08 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-5e1bd11b-27b3-4591-b9a9-179305d034a2 tempest-VolumesListTestJSON-823570032 None] Lock "cinder-quobyte-d75f2272-39af-4f45-87b8-115a5c631bed" released by "delete_volume" :: held 1.852s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:08 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-5e1bd11b-27b3-4591-b9a9-179305d034a2 tempest-VolumesListTestJSON-823570032 None] Created reservations ['5b0abb9a-c25e-4cb7-b5e1-68e5aa4b8d8f', '73f026e7-7619-4431-adbd-1f218c017d9e', 'ef2156bc-49f6-46b1-83d3-aa2596ff3515', 'd220cb1b-442d-4f2e-8c42-3290db2c078c'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:18:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5e1bd11b-27b3-4591-b9a9-179305d034a2 tempest-VolumesListTestJSON-823570032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5e1bd11b-27b3-4591-b9a9-179305d034a2 tempest-VolumesListTestJSON-823570032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:08 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-5e1bd11b-27b3-4591-b9a9-179305d034a2 tempest-VolumesListTestJSON-823570032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:18:08 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-5e1bd11b-27b3-4591-b9a9-179305d034a2 tempest-VolumesListTestJSON-823570032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:18:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5e1bd11b-27b3-4591-b9a9-179305d034a2 tempest-VolumesListTestJSON-823570032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5e1bd11b-27b3-4591-b9a9-179305d034a2 tempest-VolumesListTestJSON-823570032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:09 devstack sudo[93356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:18:09 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9ef9acc4-9c12-4d77-a5af-669234a7a98c tempest-VolumesListTestJSON-823570032 None] Acquiring lock "cinder-46d6aae5-ecad-429d-ba28-407a4fce2c80-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:09 devstack sudo[93356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:09 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9ef9acc4-9c12-4d77-a5af-669234a7a98c tempest-VolumesListTestJSON-823570032 None] Lock "cinder-46d6aae5-ecad-429d-ba28-407a4fce2c80-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:09 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9ef9acc4-9c12-4d77-a5af-669234a7a98c tempest-VolumesListTestJSON-823570032 None] Acquiring lock "cinder-quobyte-46d6aae5-ecad-429d-ba28-407a4fce2c80" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:09 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9ef9acc4-9c12-4d77-a5af-669234a7a98c tempest-VolumesListTestJSON-823570032 None] Lock "cinder-quobyte-46d6aae5-ecad-429d-ba28-407a4fce2c80" acquired by "delete_volume" :: waited 0.069s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:09 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce9dec6-94a9-4c9a-9898-35356d7d6fe8]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:18:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9ef9acc4-9c12-4d77-a5af-669234a7a98c tempest-VolumesListTestJSON-823570032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-46d6aae5-ecad-429d-ba28-407a4fce2c80 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:09 devstack sudo[93356]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5e1bd11b-27b3-4591-b9a9-179305d034a2 tempest-VolumesListTestJSON-823570032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.704s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:09 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-5e1bd11b-27b3-4591-b9a9-179305d034a2 tempest-VolumesListTestJSON-823570032 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:18:09 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-5e1bd11b-27b3-4591-b9a9-179305d034a2 tempest-VolumesListTestJSON-823570032 None] Deleted volume successfully. Sep 01 08:18:09 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-5e1bd11b-27b3-4591-b9a9-179305d034a2 tempest-VolumesListTestJSON-823570032 None] Lock "cinder-d75f2272-39af-4f45-87b8-115a5c631bed-delete_volume" released by "delete_volume" :: held 3.523s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:09 devstack sudo[93359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-46d6aae5-ecad-429d-ba28-407a4fce2c80 Sep 01 08:18:09 devstack sudo[93359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:10 devstack sudo[93359]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9ef9acc4-9c12-4d77-a5af-669234a7a98c tempest-VolumesListTestJSON-823570032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-46d6aae5-ecad-429d-ba28-407a4fce2c80" returned: 0 in 0.918s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9ef9acc4-9c12-4d77-a5af-669234a7a98c tempest-VolumesListTestJSON-823570032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-46d6aae5-ecad-429d-ba28-407a4fce2c80 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:10 devstack sudo[93364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-46d6aae5-ecad-429d-ba28-407a4fce2c80 Sep 01 08:18:10 devstack sudo[93364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:11 devstack sudo[93364]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9ef9acc4-9c12-4d77-a5af-669234a7a98c tempest-VolumesListTestJSON-823570032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-46d6aae5-ecad-429d-ba28-407a4fce2c80" returned: 0 in 0.896s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:11 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9ef9acc4-9c12-4d77-a5af-669234a7a98c tempest-VolumesListTestJSON-823570032 None] Lock "cinder-quobyte-46d6aae5-ecad-429d-ba28-407a4fce2c80" released by "delete_volume" :: held 1.996s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:11 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-9ef9acc4-9c12-4d77-a5af-669234a7a98c tempest-VolumesListTestJSON-823570032 None] Created reservations ['ccf42185-6c47-4b80-a5b7-f26d360cf24b', 'c82d998a-731c-4302-b2d6-7ff9493520d0', 'cd106ed8-02cd-4b47-bcb6-6d42a01afef2', '07600a5d-c741-4752-9beb-b1a54eb68023'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:18:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9ef9acc4-9c12-4d77-a5af-669234a7a98c tempest-VolumesListTestJSON-823570032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9ef9acc4-9c12-4d77-a5af-669234a7a98c tempest-VolumesListTestJSON-823570032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:11 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-9ef9acc4-9c12-4d77-a5af-669234a7a98c tempest-VolumesListTestJSON-823570032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:18:11 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-9ef9acc4-9c12-4d77-a5af-669234a7a98c tempest-VolumesListTestJSON-823570032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:18:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9ef9acc4-9c12-4d77-a5af-669234a7a98c tempest-VolumesListTestJSON-823570032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9ef9acc4-9c12-4d77-a5af-669234a7a98c tempest-VolumesListTestJSON-823570032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:11 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-27f997b3-3625-4a32-93d1-e4b5fab7d86c tempest-AttachVolumeShelveTestJSON-711447314 None] Acquiring lock "cinder-94b13d40-8ba1-4f53-976a-94785c1180e7-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:11 devstack sudo[93367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:18:11 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:11 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-27f997b3-3625-4a32-93d1-e4b5fab7d86c tempest-AttachVolumeShelveTestJSON-711447314 None] Lock "cinder-94b13d40-8ba1-4f53-976a-94785c1180e7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:11 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-27f997b3-3625-4a32-93d1-e4b5fab7d86c tempest-AttachVolumeShelveTestJSON-711447314 None] Acquiring lock "cinder-quobyte-94b13d40-8ba1-4f53-976a-94785c1180e7" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:11 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-27f997b3-3625-4a32-93d1-e4b5fab7d86c tempest-AttachVolumeShelveTestJSON-711447314 None] Lock "cinder-quobyte-94b13d40-8ba1-4f53-976a-94785c1180e7" acquired by "delete_volume" :: waited 0.030s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:11 devstack sudo[93322]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9742bbc8-a640-4123-8f23-787520376ba0" returned: 0 in 7.534s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:11 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Image conversion details: src /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1, size 1024.00 MB, duration 7.54 sec, destination /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9742bbc8-a640-4123-8f23-787520376ba0 {{(pid=86893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 08:18:11 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Converted 1024.00 MB image at 135.86 MB/s Sep 01 08:18:11 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9742bbc8-a640-4123-8f23-787520376ba0 is being set with open permissions: ugo+rw Sep 01 08:18:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9742bbc8-a640-4123-8f23-787520376ba0 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:11 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[defcb43a-82d4-4a65-8b27-04ad53716267]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:18:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27f997b3-3625-4a32-93d1-e4b5fab7d86c tempest-AttachVolumeShelveTestJSON-711447314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-94b13d40-8ba1-4f53-976a-94785c1180e7 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:11 devstack sudo[93369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9742bbc8-a640-4123-8f23-787520376ba0 Sep 01 08:18:11 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:12 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9ef9acc4-9c12-4d77-a5af-669234a7a98c tempest-VolumesListTestJSON-823570032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.388s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:12 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-9ef9acc4-9c12-4d77-a5af-669234a7a98c tempest-VolumesListTestJSON-823570032 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:18:12 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-9ef9acc4-9c12-4d77-a5af-669234a7a98c tempest-VolumesListTestJSON-823570032 None] Deleted volume successfully. Sep 01 08:18:12 devstack sudo[93370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-94b13d40-8ba1-4f53-976a-94785c1180e7 Sep 01 08:18:12 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:12 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9ef9acc4-9c12-4d77-a5af-669234a7a98c tempest-VolumesListTestJSON-823570032 None] Lock "cinder-46d6aae5-ecad-429d-ba28-407a4fce2c80-delete_volume" released by "delete_volume" :: held 2.995s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:12 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9742bbc8-a640-4123-8f23-787520376ba0" returned: 0 in 0.284s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:12 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Lock "cinder-quobyte-9742bbc8-a640-4123-8f23-787520376ba0" released by "_copy_volume_from_snapshot" :: held 9.560s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:12 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Acquiring lock "cinder-quobyte-4b48e104-961c-4473-ad6a-0b07ff1415e8" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:12 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Lock "cinder-quobyte-4b48e104-961c-4473-ad6a-0b07ff1415e8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:12 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Deleting offline snapshot 4b48e104-961c-4473-ad6a-0b07ff1415e8 of volume 09cd98af-cf69-4478-9140-bd2c6c3cf8a1 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:18:12 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] snapshot_file for this snap is: volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1.4b48e104-961c-4473-ad6a-0b07ff1415e8 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:18:12 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[65609179-7806-4833-bc19-6e63adf23329]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:18:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1.4b48e104-961c-4473-ad6a-0b07ff1415e8 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:12 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27f997b3-3625-4a32-93d1-e4b5fab7d86c tempest-AttachVolumeShelveTestJSON-711447314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-94b13d40-8ba1-4f53-976a-94785c1180e7" returned: 0 in 0.390s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27f997b3-3625-4a32-93d1-e4b5fab7d86c tempest-AttachVolumeShelveTestJSON-711447314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-94b13d40-8ba1-4f53-976a-94785c1180e7 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:12 devstack sudo[93380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-94b13d40-8ba1-4f53-976a-94785c1180e7 Sep 01 08:18:12 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:12 devstack sudo[93379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1.4b48e104-961c-4473-ad6a-0b07ff1415e8 Sep 01 08:18:12 devstack sudo[93379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:12 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27f997b3-3625-4a32-93d1-e4b5fab7d86c tempest-AttachVolumeShelveTestJSON-711447314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-94b13d40-8ba1-4f53-976a-94785c1180e7" returned: 0 in 0.279s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:12 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-27f997b3-3625-4a32-93d1-e4b5fab7d86c tempest-AttachVolumeShelveTestJSON-711447314 None] Lock "cinder-quobyte-94b13d40-8ba1-4f53-976a-94785c1180e7" released by "delete_volume" :: held 0.735s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:12 devstack sudo[93379]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1.4b48e104-961c-4473-ad6a-0b07ff1415e8" returned: 0 in 0.390s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:12 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:18:12 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-27f997b3-3625-4a32-93d1-e4b5fab7d86c tempest-AttachVolumeShelveTestJSON-711447314 None] Created reservations ['5b56ea7e-6be0-4002-917a-49bce19b2641', '30ce6367-6041-4149-8fed-1943a5fe44e8', 'e00c817f-e8f8-42b4-9d6c-762215256db7', '88c21cf8-25cd-4bb2-b343-f0d711c8b287'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:18:12 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c3351c-b16e-4c0e-a183-33f2da4889d3]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:18:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-27f997b3-3625-4a32-93d1-e4b5fab7d86c tempest-AttachVolumeShelveTestJSON-711447314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-27f997b3-3625-4a32-93d1-e4b5fab7d86c tempest-AttachVolumeShelveTestJSON-711447314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:12 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-27f997b3-3625-4a32-93d1-e4b5fab7d86c tempest-AttachVolumeShelveTestJSON-711447314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:18:12 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-27f997b3-3625-4a32-93d1-e4b5fab7d86c tempest-AttachVolumeShelveTestJSON-711447314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:18:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-27f997b3-3625-4a32-93d1-e4b5fab7d86c tempest-AttachVolumeShelveTestJSON-711447314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27f997b3-3625-4a32-93d1-e4b5fab7d86c tempest-AttachVolumeShelveTestJSON-711447314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:12 devstack sudo[93387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1 Sep 01 08:18:12 devstack sudo[93387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:12 devstack sudo[93388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:18:12 devstack sudo[93388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:13 devstack sudo[93388]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27f997b3-3625-4a32-93d1-e4b5fab7d86c tempest-AttachVolumeShelveTestJSON-711447314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.459s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:13 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-27f997b3-3625-4a32-93d1-e4b5fab7d86c tempest-AttachVolumeShelveTestJSON-711447314 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:18:13 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-27f997b3-3625-4a32-93d1-e4b5fab7d86c tempest-AttachVolumeShelveTestJSON-711447314 None] Deleted volume successfully. Sep 01 08:18:13 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-27f997b3-3625-4a32-93d1-e4b5fab7d86c tempest-AttachVolumeShelveTestJSON-711447314 None] Lock "cinder-94b13d40-8ba1-4f53-976a-94785c1180e7-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:13 devstack sudo[93387]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1" returned: 0 in 0.776s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1.4b48e104-961c-4473-ad6a-0b07ff1415e8 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:13 devstack sudo[93396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1.4b48e104-961c-4473-ad6a-0b07ff1415e8 Sep 01 08:18:13 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:14 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1.4b48e104-961c-4473-ad6a-0b07ff1415e8" returned: 0 in 0.483s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1.4b48e104-961c-4473-ad6a-0b07ff1415e8 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:14 devstack sudo[93402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1.4b48e104-961c-4473-ad6a-0b07ff1415e8 Sep 01 08:18:14 devstack sudo[93402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:14 devstack sudo[93402]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1.4b48e104-961c-4473-ad6a-0b07ff1415e8" returned: 0 in 0.426s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:14 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Lock "cinder-quobyte-4b48e104-961c-4473-ad6a-0b07ff1415e8" released by "_delete_snapshot" :: held 2.204s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:14 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:UPDATE=133,cinder:SELECT=106,cinder:DELETE=7,cinder:INSERT=33 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:18:14 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=104,cinder:INSERT=39,cinder:UPDATE=125,cinder:DELETE=15 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:18:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.378s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caec9277-206c-48a0-89f2-cbecab24a118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9742bbc8-a640-4123-8f23-787520376ba0', 'volume_size': 1, 'source_volid': '09cd98af-cf69-4478-9140-bd2c6c3cf8a1', 'source_volstatus': 'available'}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b30304c9-cfed-4659-af12-206a849dc635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:14 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Volume volume-9742bbc8-a640-4123-8f23-787520376ba0 (9742bbc8-a640-4123-8f23-787520376ba0): created successfully Sep 01 08:18:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b30304c9-cfed-4659-af12-206a849dc635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Flow 'volume_create_manager' (54c85ad2-b1b1-4416-aeaf-e8802f26830a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:18:14 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-4b4b2fc6-3a1a-474e-92ec-315c1ff9d94e tempest-VolumesGetTest-843812307 None] Created volume successfully. Sep 01 08:18:16 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:18:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] Flow 'volume_create_manager' (f8fe8146-c555-4b0b-9616-c01e9ac1baff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:18:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5527197-4681-4102-a2f1-4f39107199f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5527197-4681-4102-a2f1-4f39107199f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:18:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1157613265',display_name='tempest-VolumesGetTest-Volume-1234811196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00b4642b-a3a7-4f46-89a8-1e52ab89dd71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a93088012da54b55bfc9f51c42feb372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:18:16Z,use_quota=True,user_id='18e571a18a864826971fbb4ecc696ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d492accd-f303-451e-8cb1-ae2c6a2c5ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d492accd-f303-451e-8cb1-ae2c6a2c5ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00458d5f-2e41-4337-99dd-7dee8c762263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00458d5f-2e41-4337-99dd-7dee8c762263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00b4642b-a3a7-4f46-89a8-1e52ab89dd71', 'volume_name': 'volume-00b4642b-a3a7-4f46-89a8-1e52ab89dd71', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13927d23-4029-47aa-b0d8-22704a49b95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13927d23-4029-47aa-b0d8-22704a49b95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bee7a09-6e60-4014-8594-ea9865b3d51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:16 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] Volume 00b4642b-a3a7-4f46-89a8-1e52ab89dd71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00b4642b-a3a7-4f46-89a8-1e52ab89dd71', 'volume_size': 1} Sep 01 08:18:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:18:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1157613265',display_name='tempest-VolumesGetTest-Volume-1234811196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00b4642b-a3a7-4f46-89a8-1e52ab89dd71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a93088012da54b55bfc9f51c42feb372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:18:16Z,use_quota=True,user_id='18e571a18a864826971fbb4ecc696ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:18:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] Creating volume 00b4642b-a3a7-4f46-89a8-1e52ab89dd71 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:18:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:18:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:18:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:18:16 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:18:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-00b4642b-a3a7-4f46-89a8-1e52ab89dd71 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:16 devstack sudo[93445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-00b4642b-a3a7-4f46-89a8-1e52ab89dd71 1073741824 Sep 01 08:18:16 devstack sudo[93445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:17 devstack sudo[93445]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-00b4642b-a3a7-4f46-89a8-1e52ab89dd71 1073741824" returned: 0 in 0.571s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-00b4642b-a3a7-4f46-89a8-1e52ab89dd71 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:17 devstack sudo[93452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-00b4642b-a3a7-4f46-89a8-1e52ab89dd71 Sep 01 08:18:17 devstack sudo[93452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:17 devstack sudo[93452]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-00b4642b-a3a7-4f46-89a8-1e52ab89dd71" returned: 0 in 0.269s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:17 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:18:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:17 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bee7a09-6e60-4014-8594-ea9865b3d51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00b4642b-a3a7-4f46-89a8-1e52ab89dd71', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:17 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c210a2-48f5-44ab-9ad5-3fa5f1d14a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:17 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] Volume volume-00b4642b-a3a7-4f46-89a8-1e52ab89dd71 (00b4642b-a3a7-4f46-89a8-1e52ab89dd71): created successfully Sep 01 08:18:17 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c210a2-48f5-44ab-9ad5-3fa5f1d14a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:17 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] Flow 'volume_create_manager' (f8fe8146-c555-4b0b-9616-c01e9ac1baff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:18:17 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-c33b7861-0e1c-4b35-b3f8-48b7d12ebf26 tempest-VolumesGetTest-843812307 None] Created volume successfully. Sep 01 08:18:18 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-04ac5b11-0a06-4a96-a875-c9d0d784c6de tempest-VolumesGetTest-843812307 None] Acquiring lock "cinder-00b4642b-a3a7-4f46-89a8-1e52ab89dd71-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:18 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-04ac5b11-0a06-4a96-a875-c9d0d784c6de tempest-VolumesGetTest-843812307 None] Lock "cinder-00b4642b-a3a7-4f46-89a8-1e52ab89dd71-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:18 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-04ac5b11-0a06-4a96-a875-c9d0d784c6de tempest-VolumesGetTest-843812307 None] Acquiring lock "cinder-quobyte-00b4642b-a3a7-4f46-89a8-1e52ab89dd71" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:18 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-04ac5b11-0a06-4a96-a875-c9d0d784c6de tempest-VolumesGetTest-843812307 None] Lock "cinder-quobyte-00b4642b-a3a7-4f46-89a8-1e52ab89dd71" acquired by "delete_volume" :: waited 0.027s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:18 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[49099134-3d27-44e2-a47b-406ae24e5f78]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:18:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-04ac5b11-0a06-4a96-a875-c9d0d784c6de tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-00b4642b-a3a7-4f46-89a8-1e52ab89dd71 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:18 devstack sudo[93456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-00b4642b-a3a7-4f46-89a8-1e52ab89dd71 Sep 01 08:18:18 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:19 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-04ac5b11-0a06-4a96-a875-c9d0d784c6de tempest-VolumesGetTest-843812307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-00b4642b-a3a7-4f46-89a8-1e52ab89dd71" returned: 0 in 0.429s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-04ac5b11-0a06-4a96-a875-c9d0d784c6de tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-00b4642b-a3a7-4f46-89a8-1e52ab89dd71 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:19 devstack sudo[93463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-00b4642b-a3a7-4f46-89a8-1e52ab89dd71 Sep 01 08:18:19 devstack sudo[93463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:19 devstack sudo[93463]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-04ac5b11-0a06-4a96-a875-c9d0d784c6de tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-00b4642b-a3a7-4f46-89a8-1e52ab89dd71" returned: 0 in 0.267s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:19 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-04ac5b11-0a06-4a96-a875-c9d0d784c6de tempest-VolumesGetTest-843812307 None] Lock "cinder-quobyte-00b4642b-a3a7-4f46-89a8-1e52ab89dd71" released by "delete_volume" :: held 0.753s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:19 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-04ac5b11-0a06-4a96-a875-c9d0d784c6de tempest-VolumesGetTest-843812307 None] Created reservations ['c3742023-b07e-4a80-80db-2c6ebe9d02e5', 'b19cdc00-6b32-4066-a13b-17972df9d694', 'ac3f5a4a-ff7c-4d8e-8f6a-bbaf2363990b', 'a7ea9adc-e562-4987-97d7-97850c3e54f9'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:18:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-04ac5b11-0a06-4a96-a875-c9d0d784c6de tempest-VolumesGetTest-843812307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-04ac5b11-0a06-4a96-a875-c9d0d784c6de tempest-VolumesGetTest-843812307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:19 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-04ac5b11-0a06-4a96-a875-c9d0d784c6de tempest-VolumesGetTest-843812307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:18:19 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-04ac5b11-0a06-4a96-a875-c9d0d784c6de tempest-VolumesGetTest-843812307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:18:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-04ac5b11-0a06-4a96-a875-c9d0d784c6de tempest-VolumesGetTest-843812307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-04ac5b11-0a06-4a96-a875-c9d0d784c6de tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:19 devstack sudo[93466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:18:19 devstack sudo[93466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:19 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ce9d400a-aaf8-445f-9d29-cddc81ae4b9b tempest-VolumesGetTest-843812307 None] Acquiring lock "cinder-9742bbc8-a640-4123-8f23-787520376ba0-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ce9d400a-aaf8-445f-9d29-cddc81ae4b9b tempest-VolumesGetTest-843812307 None] Lock "cinder-9742bbc8-a640-4123-8f23-787520376ba0-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:20 devstack sudo[93466]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-04ac5b11-0a06-4a96-a875-c9d0d784c6de tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.369s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:20 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-04ac5b11-0a06-4a96-a875-c9d0d784c6de tempest-VolumesGetTest-843812307 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:18:20 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-04ac5b11-0a06-4a96-a875-c9d0d784c6de tempest-VolumesGetTest-843812307 None] Deleted volume successfully. Sep 01 08:18:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ce9d400a-aaf8-445f-9d29-cddc81ae4b9b tempest-VolumesGetTest-843812307 None] Acquiring lock "cinder-quobyte-9742bbc8-a640-4123-8f23-787520376ba0" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-04ac5b11-0a06-4a96-a875-c9d0d784c6de tempest-VolumesGetTest-843812307 None] Lock "cinder-00b4642b-a3a7-4f46-89a8-1e52ab89dd71-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ce9d400a-aaf8-445f-9d29-cddc81ae4b9b tempest-VolumesGetTest-843812307 None] Lock "cinder-quobyte-9742bbc8-a640-4123-8f23-787520376ba0" acquired by "delete_volume" :: waited 0.024s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:20 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[355aa509-963c-4e2d-b07f-39071e6c463a]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:18:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ce9d400a-aaf8-445f-9d29-cddc81ae4b9b tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9742bbc8-a640-4123-8f23-787520376ba0 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:20 devstack sudo[93469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9742bbc8-a640-4123-8f23-787520376ba0 Sep 01 08:18:20 devstack sudo[93469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:20 devstack sudo[93469]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ce9d400a-aaf8-445f-9d29-cddc81ae4b9b tempest-VolumesGetTest-843812307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9742bbc8-a640-4123-8f23-787520376ba0" returned: 0 in 0.449s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ce9d400a-aaf8-445f-9d29-cddc81ae4b9b tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9742bbc8-a640-4123-8f23-787520376ba0 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:20 devstack sudo[93475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9742bbc8-a640-4123-8f23-787520376ba0 Sep 01 08:18:20 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:20 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ce9d400a-aaf8-445f-9d29-cddc81ae4b9b tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9742bbc8-a640-4123-8f23-787520376ba0" returned: 0 in 0.287s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ce9d400a-aaf8-445f-9d29-cddc81ae4b9b tempest-VolumesGetTest-843812307 None] Lock "cinder-quobyte-9742bbc8-a640-4123-8f23-787520376ba0" released by "delete_volume" :: held 0.798s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:21 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-ce9d400a-aaf8-445f-9d29-cddc81ae4b9b tempest-VolumesGetTest-843812307 None] Created reservations ['22af0c73-bc42-4334-ae62-28eb27f62bef', 'f19ebe6d-6098-452b-aa33-94e3b5436fc3', '0dd2bf89-5165-4af1-a509-06cff24e90d2', '5dd4161d-7672-49a7-8b05-bb80ac8a7656'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:18:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ce9d400a-aaf8-445f-9d29-cddc81ae4b9b tempest-VolumesGetTest-843812307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ce9d400a-aaf8-445f-9d29-cddc81ae4b9b tempest-VolumesGetTest-843812307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ce9d400a-aaf8-445f-9d29-cddc81ae4b9b tempest-VolumesGetTest-843812307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:18:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ce9d400a-aaf8-445f-9d29-cddc81ae4b9b tempest-VolumesGetTest-843812307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:18:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ce9d400a-aaf8-445f-9d29-cddc81ae4b9b tempest-VolumesGetTest-843812307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ce9d400a-aaf8-445f-9d29-cddc81ae4b9b tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:21 devstack sudo[93479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:18:21 devstack sudo[93479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:21 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1d3c2b3a-7511-428c-a3f3-d594d0a730cc tempest-VolumesGetTest-843812307 None] Acquiring lock "cinder-09cd98af-cf69-4478-9140-bd2c6c3cf8a1-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:21 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1d3c2b3a-7511-428c-a3f3-d594d0a730cc tempest-VolumesGetTest-843812307 None] Lock "cinder-09cd98af-cf69-4478-9140-bd2c6c3cf8a1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:21 devstack sudo[93479]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:21 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1d3c2b3a-7511-428c-a3f3-d594d0a730cc tempest-VolumesGetTest-843812307 None] Acquiring lock "cinder-quobyte-09cd98af-cf69-4478-9140-bd2c6c3cf8a1" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ce9d400a-aaf8-445f-9d29-cddc81ae4b9b tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.357s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:21 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-ce9d400a-aaf8-445f-9d29-cddc81ae4b9b tempest-VolumesGetTest-843812307 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:18:21 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-ce9d400a-aaf8-445f-9d29-cddc81ae4b9b tempest-VolumesGetTest-843812307 None] Deleted volume successfully. Sep 01 08:18:21 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1d3c2b3a-7511-428c-a3f3-d594d0a730cc tempest-VolumesGetTest-843812307 None] Lock "cinder-quobyte-09cd98af-cf69-4478-9140-bd2c6c3cf8a1" acquired by "delete_volume" :: waited 0.038s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:21 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ce9d400a-aaf8-445f-9d29-cddc81ae4b9b tempest-VolumesGetTest-843812307 None] Lock "cinder-9742bbc8-a640-4123-8f23-787520376ba0-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:21 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d86c7b7-68e5-47cf-ac67-a10e911eb223]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:18:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1d3c2b3a-7511-428c-a3f3-d594d0a730cc tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:21 devstack sudo[93488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1 Sep 01 08:18:21 devstack sudo[93488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:22 devstack sudo[93488]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1d3c2b3a-7511-428c-a3f3-d594d0a730cc tempest-VolumesGetTest-843812307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1" returned: 0 in 0.576s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1d3c2b3a-7511-428c-a3f3-d594d0a730cc tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:22 devstack sudo[93496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1 Sep 01 08:18:22 devstack sudo[93496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:22 devstack sudo[93496]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1d3c2b3a-7511-428c-a3f3-d594d0a730cc tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-09cd98af-cf69-4478-9140-bd2c6c3cf8a1" returned: 0 in 0.414s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:22 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1d3c2b3a-7511-428c-a3f3-d594d0a730cc tempest-VolumesGetTest-843812307 None] Lock "cinder-quobyte-09cd98af-cf69-4478-9140-bd2c6c3cf8a1" released by "delete_volume" :: held 1.091s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:22 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-1d3c2b3a-7511-428c-a3f3-d594d0a730cc tempest-VolumesGetTest-843812307 None] Created reservations ['0a24d93d-91aa-4280-b8a3-ea0accf05742', 'ce54b2eb-f253-4e95-b926-ace5e2ee1365', '8ce412ed-2a74-40d4-a502-5456a372ca09', 'f8d9f5cf-1640-4cb2-8465-c0c129a2a985'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:18:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1d3c2b3a-7511-428c-a3f3-d594d0a730cc tempest-VolumesGetTest-843812307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1d3c2b3a-7511-428c-a3f3-d594d0a730cc tempest-VolumesGetTest-843812307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1d3c2b3a-7511-428c-a3f3-d594d0a730cc tempest-VolumesGetTest-843812307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:18:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1d3c2b3a-7511-428c-a3f3-d594d0a730cc tempest-VolumesGetTest-843812307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:18:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1d3c2b3a-7511-428c-a3f3-d594d0a730cc tempest-VolumesGetTest-843812307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1d3c2b3a-7511-428c-a3f3-d594d0a730cc tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:22 devstack sudo[93499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:18:22 devstack sudo[93499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:23 devstack sudo[93499]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1d3c2b3a-7511-428c-a3f3-d594d0a730cc tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.312s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:23 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-1d3c2b3a-7511-428c-a3f3-d594d0a730cc tempest-VolumesGetTest-843812307 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:18:23 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-1d3c2b3a-7511-428c-a3f3-d594d0a730cc tempest-VolumesGetTest-843812307 None] Deleted volume successfully. Sep 01 08:18:23 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1d3c2b3a-7511-428c-a3f3-d594d0a730cc tempest-VolumesGetTest-843812307 None] Lock "cinder-09cd98af-cf69-4478-9140-bd2c6c3cf8a1-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:24 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:18:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Flow 'volume_create_manager' (ebe1c5ea-db0e-435f-a327-ef3c590590f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:18:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f9946c7-9b84-4d06-987a-cd77ae25e872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f9946c7-9b84-4d06-987a-cd77ae25e872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1070231917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=109b9cf0-7528-4b29-9a76-40cab1e35c0d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a93088012da54b55bfc9f51c42feb372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:18:24Z,use_quota=True,user_id='18e571a18a864826971fbb4ecc696ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de9a706-704f-4e1f-b151-7b6f04e1227c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de9a706-704f-4e1f-b151-7b6f04e1227c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (359ef34d-2cfa-4aba-8ab8-70a662298815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:24 devstack cinder-volume[86893]: DEBUG cinder.image.glance [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Creating Keystone auth plugin from conf {{(pid=86893) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 08:18:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (359ef34d-2cfa-4aba-8ab8-70a662298815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '109b9cf0-7528-4b29-9a76-40cab1e35c0d', 'volume_name': 'volume-109b9cf0-7528-4b29-9a76-40cab1e35c0d', 'volume_size': 1, 'image_id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a80c3dd0151a4e4aacd690bfb315fb01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'created_at': datetime.datetime(2026, 9, 1, 6, 7, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 6, 7, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16456683-2bdf-4908-879e-2fee63656c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16456683-2bdf-4908-879e-2fee63656c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e03a085c-54b8-4e04-a411-b436db2a0d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:25 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Volume 109b9cf0-7528-4b29-9a76-40cab1e35c0d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-109b9cf0-7528-4b29-9a76-40cab1e35c0d', 'volume_size': 1, 'image_id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a80c3dd0151a4e4aacd690bfb315fb01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'created_at': datetime.datetime(2026, 9, 1, 6, 7, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 6, 7, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 08:18:25 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Trying to clone 109b9cf0-7528-4b29-9a76-40cab1e35c0d from image 00f5a94d-dba5-4527-9ce8-7a00c3b29ced at location (None, [{'url': 'file:///opt/stack/data/glance/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'metadata': {}}]). {{(pid=86893) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1100}} Sep 01 08:18:25 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_k5txpeoedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86893) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 08:18:25 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Image download 20.69 MB at 20.69 MB/s Sep 01 08:18:25 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b0bdf2-29d9-4ab0-9285-f9f6cc5a4726]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:18:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_k5txpeoedevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:25 devstack sudo[93503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_k5txpeoedevstack@QuobyteHD Sep 01 08:18:25 devstack sudo[93503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:26 devstack sudo[93503]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_k5txpeoedevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:26 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Temporary image 00f5a94d-dba5-4527-9ce8-7a00c3b29ced is fetched for user 18e571a18a864826971fbb4ecc696ee4. {{(pid=86893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 08:18:26 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[29672f88-d0b7-46b3-a81e-a060ed061d63]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:18:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_k5txpeoedevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:26 devstack sudo[93509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_k5txpeoedevstack@QuobyteHD Sep 01 08:18:26 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:26 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_k5txpeoedevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:26 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1070231917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=109b9cf0-7528-4b29-9a76-40cab1e35c0d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a93088012da54b55bfc9f51c42feb372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:18:24Z,use_quota=True,user_id='18e571a18a864826971fbb4ecc696ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:18:26 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Creating volume 109b9cf0-7528-4b29-9a76-40cab1e35c0d {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:18:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:26 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:18:26 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:18:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:26 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:18:26 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:18:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-109b9cf0-7528-4b29-9a76-40cab1e35c0d 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:26 devstack sudo[93515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-109b9cf0-7528-4b29-9a76-40cab1e35c0d 1073741824 Sep 01 08:18:26 devstack sudo[93515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:27 devstack sudo[93515]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-109b9cf0-7528-4b29-9a76-40cab1e35c0d 1073741824" returned: 0 in 0.693s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-109b9cf0-7528-4b29-9a76-40cab1e35c0d {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:27 devstack sudo[93522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-109b9cf0-7528-4b29-9a76-40cab1e35c0d Sep 01 08:18:27 devstack sudo[93522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:27 devstack sudo[93522]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-109b9cf0-7528-4b29-9a76-40cab1e35c0d" returned: 0 in 0.480s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:18:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:27 devstack cinder-volume[86893]: DEBUG cinder.volume.volume_utils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Attempting download of 00f5a94d-dba5-4527-9ce8-7a00c3b29ced ((None, [{'url': 'file:///opt/stack/data/glance/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'metadata': {}}])) to volume 109b9cf0-7528-4b29-9a76-40cab1e35c0d. {{(pid=86893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 08:18:27 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6e2214-6952-48de-826b-e95e3e3b5d0e]: (4, 'raw') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:18:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_xkixo6s4 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:28 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:18:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] Flow 'volume_create_manager' (d3e151f5-d493-4c1e-805f-5078364569f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:18:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97300991-e77b-416c-b9a6-8b6226e873c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97300991-e77b-416c-b9a6-8b6226e873c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1901303281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='177f24a70dd44c9a968d7268c68984d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:18:28Z,use_quota=True,user_id='26dcf215534d48e7b958182081bd184a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ac35a3f-3297-4373-9ced-af9f2b76097a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ac35a3f-3297-4373-9ced-af9f2b76097a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56585187-cb51-4171-b905-cf5e6afffaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56585187-cb51-4171-b905-cf5e6afffaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916', 'volume_name': 'volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:28 devstack sudo[93525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_xkixo6s4 Sep 01 08:18:28 devstack sudo[93525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a4b3a4-9d40-4927-bc91-1d8d8a9a4936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a4b3a4-9d40-4927-bc91-1d8d8a9a4936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48bfacac-d4bb-440e-a545-409eb5eeb088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:28 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] Volume e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916', 'volume_size': 1} Sep 01 08:18:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1901303281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='177f24a70dd44c9a968d7268c68984d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:18:28Z,use_quota=True,user_id='26dcf215534d48e7b958182081bd184a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:18:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] Creating volume e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:18:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:18:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:18:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:18:28 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:18:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:28 devstack sudo[93527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916 1073741824 Sep 01 08:18:28 devstack sudo[93527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:28 devstack sudo[93525]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_xkixo6s4" returned: 0 in 0.382s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_xkixo6s4 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:28 devstack sudo[93531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_xkixo6s4 Sep 01 08:18:28 devstack sudo[93531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:28 devstack sudo[93527]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916 1073741824" returned: 0 in 0.537s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:28 devstack sudo[93548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916 Sep 01 08:18:28 devstack sudo[93548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:28 devstack sudo[93531]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_xkixo6s4" returned: 1 in 0.532s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_xkixo6s4' failed. Not Retrying. {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 08:18:28 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc3a62d-ae93-4619-ac20-36f22b17c784]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:18:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_k5txpeoedevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:29 devstack sudo[93550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_k5txpeoedevstack@QuobyteHD Sep 01 08:18:29 devstack sudo[93550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:29 devstack sudo[93548]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916" returned: 0 in 0.467s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:18:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48bfacac-d4bb-440e-a545-409eb5eeb088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20031bbc-1294-4d7c-8a82-4f666005b683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:29 devstack sudo[93550]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_k5txpeoedevstack@QuobyteHD" returned: 0 in 0.447s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:29 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] 00f5a94d-dba5-4527-9ce8-7a00c3b29ced was qcow2, converting to qcow2 {{(pid=86893) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 08:18:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_k5txpeoedevstack@QuobyteHD /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-109b9cf0-7528-4b29-9a76-40cab1e35c0d {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:29 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] Volume volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916 (e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916): created successfully Sep 01 08:18:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20031bbc-1294-4d7c-8a82-4f666005b683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] Flow 'volume_create_manager' (d3e151f5-d493-4c1e-805f-5078364569f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:18:29 devstack sudo[93556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_k5txpeoedevstack@QuobyteHD /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-109b9cf0-7528-4b29-9a76-40cab1e35c0d Sep 01 08:18:29 devstack sudo[93556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:29 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-7139ebb2-d46d-47f7-b8ce-d288ba2a6268 tempest-VolumesSnapshotTestJSON-1588965021 None] Created volume successfully. Sep 01 08:18:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-01295187-d853-4261-a7c6-35a226011498 tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-01295187-d853-4261-a7c6-35a226011498 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-01295187-d853-4261-a7c6-35a226011498 tempest-VolumesSnapshotTestJSON-1588965021 None] Creating offline snapshot 0680502e-4b1a-4f3b-8394-575c2b29f547 of volume e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916 {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:18:30 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[40aeaf32-fe8e-46ae-b61c-8d89d67b2503]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:18:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01295187-d853-4261-a7c6-35a226011498 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:30 devstack sudo[93591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916 Sep 01 08:18:30 devstack sudo[93591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:18:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:18:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:18:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:31 devstack sudo[93594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:18:31 devstack sudo[93594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:31 devstack sudo[93591]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01295187-d853-4261-a7c6-35a226011498 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916" returned: 0 in 0.564s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01295187-d853-4261-a7c6-35a226011498 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916.0680502e-4b1a-4f3b-8394-575c2b29f547 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:31 devstack sudo[93594]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.349s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:31 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:18:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager._thread_info {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:18:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread count: 28 {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 08:18:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread info: [<_MainThread(MainThread, started 138934582050944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 08:18:31 devstack sudo[93600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916.0680502e-4b1a-4f3b-8394-575c2b29f547 1G Sep 01 08:18:31 devstack sudo[93600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:32 devstack sudo[93556]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_k5txpeoedevstack@QuobyteHD /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-109b9cf0-7528-4b29-9a76-40cab1e35c0d" returned: 0 in 2.757s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:32 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_k5txpeoedevstack@QuobyteHD, size 112.00 MB, duration 2.76 sec, destination /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-109b9cf0-7528-4b29-9a76-40cab1e35c0d {{(pid=86893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 08:18:32 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Converted 112.00 MB image at 40.56 MB/s Sep 01 08:18:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-109b9cf0-7528-4b29-9a76-40cab1e35c0d 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:32 devstack sudo[93600]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01295187-d853-4261-a7c6-35a226011498 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916.0680502e-4b1a-4f3b-8394-575c2b29f547 1G" returned: 0 in 0.716s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01295187-d853-4261-a7c6-35a226011498 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916.0680502e-4b1a-4f3b-8394-575c2b29f547 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:32 devstack sudo[93607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-109b9cf0-7528-4b29-9a76-40cab1e35c0d 1G Sep 01 08:18:32 devstack sudo[93607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:32 devstack sudo[93608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916.0680502e-4b1a-4f3b-8394-575c2b29f547 Sep 01 08:18:32 devstack sudo[93608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:32 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-0aa03b2c-5708-4783-9a5e-50c8c49aa0e7 req-d908cb91-9c93-4cb2-b218-8172267c37c5 tempest-ServerActionsTestOtherA-1037332526 None] Terminate volume connection completed successfully. Sep 01 08:18:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-0aa03b2c-5708-4783-9a5e-50c8c49aa0e7 req-d908cb91-9c93-4cb2-b218-8172267c37c5 tempest-ServerActionsTestOtherA-1037332526 None] Deleting attachment 163042b2-d5b1-4c3b-aa43-8bbe519cb416. {{(pid=86893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 08:18:32 devstack sudo[93607]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-109b9cf0-7528-4b29-9a76-40cab1e35c0d 1G" returned: 0 in 0.445s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:32 devstack cinder-volume[86893]: DEBUG cinder.volume.volume_utils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Downloaded image 00f5a94d-dba5-4527-9ce8-7a00c3b29ced ((None, [{'url': 'file:///opt/stack/data/glance/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'metadata': {}}])) to volume 109b9cf0-7528-4b29-9a76-40cab1e35c0d successfully. {{(pid=86893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 08:18:32 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Temporary image 00f5a94d-dba5-4527-9ce8-7a00c3b29ced for user 18e571a18a864826971fbb4ecc696ee4 is deleted. {{(pid=86893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 08:18:32 devstack cinder-volume[86893]: DEBUG cinder.volume.volume_utils [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Marking volume 109b9cf0-7528-4b29-9a76-40cab1e35c0d as bootable. {{(pid=86893) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 08:18:32 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Copying metadata from image 00f5a94d-dba5-4527-9ce8-7a00c3b29ced to 109b9cf0-7528-4b29-9a76-40cab1e35c0d. {{(pid=86893) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 08:18:32 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Creating volume glance metadata for volume 109b9cf0-7528-4b29-9a76-40cab1e35c0d backed by image 00f5a94d-dba5-4527-9ce8-7a00c3b29ced with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86893) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 08:18:32 devstack sudo[93608]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:32 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-0aa03b2c-5708-4783-9a5e-50c8c49aa0e7 req-c1df8b27-f368-4405-9f7d-cbd52e020978 tempest-ServerActionsTestOtherA-1037332526 None] Acquiring lock "cinder-bacb2011-cf8f-4541-adc0-0b633c7f366a-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01295187-d853-4261-a7c6-35a226011498 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916.0680502e-4b1a-4f3b-8394-575c2b29f547" returned: 0 in 0.577s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:32 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-01295187-d853-4261-a7c6-35a226011498 tempest-VolumesSnapshotTestJSON-1588965021 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916.0680502e-4b1a-4f3b-8394-575c2b29f547 is being set with open permissions: ugo+rw Sep 01 08:18:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01295187-d853-4261-a7c6-35a226011498 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916.0680502e-4b1a-4f3b-8394-575c2b29f547 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:32 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-0aa03b2c-5708-4783-9a5e-50c8c49aa0e7 req-c1df8b27-f368-4405-9f7d-cbd52e020978 tempest-ServerActionsTestOtherA-1037332526 None] Lock "cinder-bacb2011-cf8f-4541-adc0-0b633c7f366a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:32 devstack sudo[93619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916.0680502e-4b1a-4f3b-8394-575c2b29f547 Sep 01 08:18:32 devstack sudo[93619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e03a085c-54b8-4e04-a411-b436db2a0d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-109b9cf0-7528-4b29-9a76-40cab1e35c0d', 'volume_size': 1, 'image_id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a80c3dd0151a4e4aacd690bfb315fb01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'created_at': datetime.datetime(2026, 9, 1, 6, 7, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 6, 7, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf2102a-efc2-409b-95e7-721e95dcbbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:32 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Volume volume-109b9cf0-7528-4b29-9a76-40cab1e35c0d (109b9cf0-7528-4b29-9a76-40cab1e35c0d): created successfully Sep 01 08:18:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf2102a-efc2-409b-95e7-721e95dcbbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Flow 'volume_create_manager' (ebe1c5ea-db0e-435f-a327-ef3c590590f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:18:32 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-0aa03b2c-5708-4783-9a5e-50c8c49aa0e7 req-c1df8b27-f368-4405-9f7d-cbd52e020978 tempest-ServerActionsTestOtherA-1037332526 None] Acquiring lock "cinder-quobyte-bacb2011-cf8f-4541-adc0-0b633c7f366a" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:32 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-85fd45e4-03a8-4ba5-a042-f4ad4339f266 tempest-VolumesGetTest-843812307 None] Created volume successfully. Sep 01 08:18:32 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-0aa03b2c-5708-4783-9a5e-50c8c49aa0e7 req-c1df8b27-f368-4405-9f7d-cbd52e020978 tempest-ServerActionsTestOtherA-1037332526 None] Lock "cinder-quobyte-bacb2011-cf8f-4541-adc0-0b633c7f366a" acquired by "delete_volume" :: waited 0.022s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:32 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[d593c0c6-617b-4a49-8710-2b0016183a35]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:18:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-0aa03b2c-5708-4783-9a5e-50c8c49aa0e7 req-c1df8b27-f368-4405-9f7d-cbd52e020978 tempest-ServerActionsTestOtherA-1037332526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bacb2011-cf8f-4541-adc0-0b633c7f366a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:33 devstack sudo[93621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bacb2011-cf8f-4541-adc0-0b633c7f366a Sep 01 08:18:33 devstack sudo[93621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:33 devstack sudo[93619]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01295187-d853-4261-a7c6-35a226011498 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916.0680502e-4b1a-4f3b-8394-575c2b29f547" returned: 0 in 0.388s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01295187-d853-4261-a7c6-35a226011498 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:33 devstack sudo[93624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916.info Sep 01 08:18:33 devstack sudo[93624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:33 devstack sudo[93624]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01295187-d853-4261-a7c6-35a226011498 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916.info" returned: 0 in 0.483s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:33 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-01295187-d853-4261-a7c6-35a226011498 tempest-VolumesSnapshotTestJSON-1588965021 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916.info is being set with open permissions: ugo+rw Sep 01 08:18:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01295187-d853-4261-a7c6-35a226011498 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:33 devstack sudo[93621]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-0aa03b2c-5708-4783-9a5e-50c8c49aa0e7 req-c1df8b27-f368-4405-9f7d-cbd52e020978 tempest-ServerActionsTestOtherA-1037332526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bacb2011-cf8f-4541-adc0-0b633c7f366a" returned: 0 in 0.737s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-0aa03b2c-5708-4783-9a5e-50c8c49aa0e7 req-c1df8b27-f368-4405-9f7d-cbd52e020978 tempest-ServerActionsTestOtherA-1037332526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bacb2011-cf8f-4541-adc0-0b633c7f366a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:33 devstack sudo[93630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916.info Sep 01 08:18:33 devstack sudo[93630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:33 devstack sudo[93631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bacb2011-cf8f-4541-adc0-0b633c7f366a Sep 01 08:18:33 devstack sudo[93631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-75c982be-fe54-4fd3-bf70-cc5ff1a6405c tempest-ServerActionsTestOtherA-1037332526 None] Acquiring lock "cinder-22204264-a063-49c9-b2af-4fdd2ec6ce61-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-75c982be-fe54-4fd3-bf70-cc5ff1a6405c tempest-ServerActionsTestOtherA-1037332526 None] Lock "cinder-22204264-a063-49c9-b2af-4fdd2ec6ce61-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-75c982be-fe54-4fd3-bf70-cc5ff1a6405c tempest-ServerActionsTestOtherA-1037332526 None] Acquiring lock "cinder-quobyte-22204264-a063-49c9-b2af-4fdd2ec6ce61" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-75c982be-fe54-4fd3-bf70-cc5ff1a6405c tempest-ServerActionsTestOtherA-1037332526 None] Lock "cinder-quobyte-22204264-a063-49c9-b2af-4fdd2ec6ce61" acquired by "delete_volume" :: waited 0.025s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:33 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fa9151-e57c-497c-b8dc-2af862b8f9a9]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:18:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-75c982be-fe54-4fd3-bf70-cc5ff1a6405c tempest-ServerActionsTestOtherA-1037332526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-22204264-a063-49c9-b2af-4fdd2ec6ce61 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:34 devstack sudo[93631]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-0aa03b2c-5708-4783-9a5e-50c8c49aa0e7 req-c1df8b27-f368-4405-9f7d-cbd52e020978 tempest-ServerActionsTestOtherA-1037332526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bacb2011-cf8f-4541-adc0-0b633c7f366a" returned: 0 in 0.408s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-0aa03b2c-5708-4783-9a5e-50c8c49aa0e7 req-c1df8b27-f368-4405-9f7d-cbd52e020978 tempest-ServerActionsTestOtherA-1037332526 None] Lock "cinder-quobyte-bacb2011-cf8f-4541-adc0-0b633c7f366a" released by "delete_volume" :: held 1.239s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:34 devstack sudo[93630]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01295187-d853-4261-a7c6-35a226011498 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916.info" returned: 0 in 0.532s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:34 devstack sudo[93635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-22204264-a063-49c9-b2af-4fdd2ec6ce61 Sep 01 08:18:34 devstack sudo[93635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-01295187-d853-4261-a7c6-35a226011498 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.385s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG cinder.quota [req-0aa03b2c-5708-4783-9a5e-50c8c49aa0e7 req-c1df8b27-f368-4405-9f7d-cbd52e020978 tempest-ServerActionsTestOtherA-1037332526 None] Created reservations ['be336a55-540f-4c3c-ae23-d5a3de82cdf3', 'fbb1b7cb-677f-4d25-a651-514183eae732', '2f8d3ac5-a293-4899-9ead-eaf4e397ba5d', '8be0257a-6cad-4a0f-8c7d-25f8eff5b413'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:18:34 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-01295187-d853-4261-a7c6-35a226011498 tempest-VolumesSnapshotTestJSON-1588965021 None] Create snapshot completed successfully Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-0aa03b2c-5708-4783-9a5e-50c8c49aa0e7 req-c1df8b27-f368-4405-9f7d-cbd52e020978 tempest-ServerActionsTestOtherA-1037332526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-0aa03b2c-5708-4783-9a5e-50c8c49aa0e7 req-c1df8b27-f368-4405-9f7d-cbd52e020978 tempest-ServerActionsTestOtherA-1037332526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [req-0aa03b2c-5708-4783-9a5e-50c8c49aa0e7 req-c1df8b27-f368-4405-9f7d-cbd52e020978 tempest-ServerActionsTestOtherA-1037332526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [req-0aa03b2c-5708-4783-9a5e-50c8c49aa0e7 req-c1df8b27-f368-4405-9f7d-cbd52e020978 tempest-ServerActionsTestOtherA-1037332526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-0aa03b2c-5708-4783-9a5e-50c8c49aa0e7 req-c1df8b27-f368-4405-9f7d-cbd52e020978 tempest-ServerActionsTestOtherA-1037332526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-0aa03b2c-5708-4783-9a5e-50c8c49aa0e7 req-c1df8b27-f368-4405-9f7d-cbd52e020978 tempest-ServerActionsTestOtherA-1037332526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:34 devstack sudo[93638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:18:34 devstack sudo[93638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:34 devstack sudo[93635]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-75c982be-fe54-4fd3-bf70-cc5ff1a6405c tempest-ServerActionsTestOtherA-1037332526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-22204264-a063-49c9-b2af-4fdd2ec6ce61" returned: 0 in 0.621s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-75c982be-fe54-4fd3-bf70-cc5ff1a6405c tempest-ServerActionsTestOtherA-1037332526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-22204264-a063-49c9-b2af-4fdd2ec6ce61 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:34 devstack sudo[93643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-22204264-a063-49c9-b2af-4fdd2ec6ce61 Sep 01 08:18:34 devstack sudo[93643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] Flow 'volume_create_manager' (ae0aca1e-7b4b-47a9-895a-271e5f6780f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84c0c5cf-e4ed-4c82-96e0-d03916786474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:34 devstack sudo[93638]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84c0c5cf-e4ed-4c82-96e0-d03916786474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:18:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-364773598',display_name='tempest-VolumesGetTest-Volume-1475287400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10b5d419-5888-417c-95ba-f4e14cdb9920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a93088012da54b55bfc9f51c42feb372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:18:35Z,use_quota=True,user_id='18e571a18a864826971fbb4ecc696ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d68be34-dcc2-46c8-89ab-f2c7fd5c5f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d68be34-dcc2-46c8-89ab-f2c7fd5c5f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f20ad97-996d-4788-9f84-47194abfb714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f20ad97-996d-4788-9f84-47194abfb714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10b5d419-5888-417c-95ba-f4e14cdb9920', 'volume_name': 'volume-10b5d419-5888-417c-95ba-f4e14cdb9920', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d47fe9d-b900-4dcb-b235-1d9b5059cb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d47fe9d-b900-4dcb-b235-1d9b5059cb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca8a35bd-f3dd-42c4-a754-7b9b20431018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:34 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] Volume 10b5d419-5888-417c-95ba-f4e14cdb9920: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10b5d419-5888-417c-95ba-f4e14cdb9920', 'volume_size': 1} Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:18:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-364773598',display_name='tempest-VolumesGetTest-Volume-1475287400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10b5d419-5888-417c-95ba-f4e14cdb9920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a93088012da54b55bfc9f51c42feb372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:18:35Z,use_quota=True,user_id='18e571a18a864826971fbb4ecc696ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] Creating volume 10b5d419-5888-417c-95ba-f4e14cdb9920 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:18:34 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-10b5d419-5888-417c-95ba-f4e14cdb9920 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-0aa03b2c-5708-4783-9a5e-50c8c49aa0e7 req-c1df8b27-f368-4405-9f7d-cbd52e020978 tempest-ServerActionsTestOtherA-1037332526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.460s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG cinder.manager [req-0aa03b2c-5708-4783-9a5e-50c8c49aa0e7 req-c1df8b27-f368-4405-9f7d-cbd52e020978 tempest-ServerActionsTestOtherA-1037332526 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:18:34 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-0aa03b2c-5708-4783-9a5e-50c8c49aa0e7 req-c1df8b27-f368-4405-9f7d-cbd52e020978 tempest-ServerActionsTestOtherA-1037332526 None] Deleted volume successfully. Sep 01 08:18:34 devstack sudo[93646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-10b5d419-5888-417c-95ba-f4e14cdb9920 1073741824 Sep 01 08:18:34 devstack sudo[93646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-0aa03b2c-5708-4783-9a5e-50c8c49aa0e7 req-c1df8b27-f368-4405-9f7d-cbd52e020978 tempest-ServerActionsTestOtherA-1037332526 None] Lock "cinder-bacb2011-cf8f-4541-adc0-0b633c7f366a-delete_volume" released by "delete_volume" :: held 2.188s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:34 devstack sudo[93643]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-75c982be-fe54-4fd3-bf70-cc5ff1a6405c tempest-ServerActionsTestOtherA-1037332526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-22204264-a063-49c9-b2af-4fdd2ec6ce61" returned: 0 in 0.346s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:34 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-75c982be-fe54-4fd3-bf70-cc5ff1a6405c tempest-ServerActionsTestOtherA-1037332526 None] Lock "cinder-quobyte-22204264-a063-49c9-b2af-4fdd2ec6ce61" released by "delete_volume" :: held 1.068s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:35 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-75c982be-fe54-4fd3-bf70-cc5ff1a6405c tempest-ServerActionsTestOtherA-1037332526 None] Created reservations ['9e4b0813-6203-4558-ba43-a76c204f425b', '0487423f-7b7c-43f9-9b97-ae763f21a0a0', '644802f0-331f-4107-8c6e-7db9e41517d1', 'eee82ad5-e76f-48bc-9b5a-9a0d15a06ead'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:18:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-75c982be-fe54-4fd3-bf70-cc5ff1a6405c tempest-ServerActionsTestOtherA-1037332526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-75c982be-fe54-4fd3-bf70-cc5ff1a6405c tempest-ServerActionsTestOtherA-1037332526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-75c982be-fe54-4fd3-bf70-cc5ff1a6405c tempest-ServerActionsTestOtherA-1037332526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:18:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-75c982be-fe54-4fd3-bf70-cc5ff1a6405c tempest-ServerActionsTestOtherA-1037332526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:18:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-75c982be-fe54-4fd3-bf70-cc5ff1a6405c tempest-ServerActionsTestOtherA-1037332526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-75c982be-fe54-4fd3-bf70-cc5ff1a6405c tempest-ServerActionsTestOtherA-1037332526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:35 devstack sudo[93652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:18:35 devstack sudo[93652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e0198da1-248a-4001-bac9-0c5e2a1296ca tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "cinder-0680502e-4b1a-4f3b-8394-575c2b29f547-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e0198da1-248a-4001-bac9-0c5e2a1296ca tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-0680502e-4b1a-4f3b-8394-575c2b29f547-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:35 devstack sudo[93646]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-10b5d419-5888-417c-95ba-f4e14cdb9920 1073741824" returned: 0 in 0.685s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e0198da1-248a-4001-bac9-0c5e2a1296ca tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "cinder-quobyte-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e0198da1-248a-4001-bac9-0c5e2a1296ca tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-quobyte-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e0198da1-248a-4001-bac9-0c5e2a1296ca tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "cinder-quobyte-0680502e-4b1a-4f3b-8394-575c2b29f547" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-10b5d419-5888-417c-95ba-f4e14cdb9920 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e0198da1-248a-4001-bac9-0c5e2a1296ca tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-quobyte-0680502e-4b1a-4f3b-8394-575c2b29f547" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-e0198da1-248a-4001-bac9-0c5e2a1296ca tempest-VolumesSnapshotTestJSON-1588965021 None] Deleting offline snapshot 0680502e-4b1a-4f3b-8394-575c2b29f547 of volume e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:18:35 devstack sudo[93656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-10b5d419-5888-417c-95ba-f4e14cdb9920 Sep 01 08:18:35 devstack sudo[93656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:35 devstack sudo[93652]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-e0198da1-248a-4001-bac9-0c5e2a1296ca tempest-VolumesSnapshotTestJSON-1588965021 None] snapshot_file for this snap is: volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916.0680502e-4b1a-4f3b-8394-575c2b29f547 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:18:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-75c982be-fe54-4fd3-bf70-cc5ff1a6405c tempest-ServerActionsTestOtherA-1037332526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.476s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:35 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-75c982be-fe54-4fd3-bf70-cc5ff1a6405c tempest-ServerActionsTestOtherA-1037332526 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:18:35 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-75c982be-fe54-4fd3-bf70-cc5ff1a6405c tempest-ServerActionsTestOtherA-1037332526 None] Deleted volume successfully. Sep 01 08:18:35 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[1977d8b1-5121-4c91-8c1b-10a2fc4d0d1e]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:18:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e0198da1-248a-4001-bac9-0c5e2a1296ca tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916.0680502e-4b1a-4f3b-8394-575c2b29f547 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-75c982be-fe54-4fd3-bf70-cc5ff1a6405c tempest-ServerActionsTestOtherA-1037332526 None] Lock "cinder-22204264-a063-49c9-b2af-4fdd2ec6ce61-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:35 devstack sudo[93658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916.0680502e-4b1a-4f3b-8394-575c2b29f547 Sep 01 08:18:35 devstack sudo[93658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:35 devstack sudo[93656]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-10b5d419-5888-417c-95ba-f4e14cdb9920" returned: 0 in 0.342s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:18:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca8a35bd-f3dd-42c4-a754-7b9b20431018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10b5d419-5888-417c-95ba-f4e14cdb9920', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe68dfbd-cae8-4871-a34f-f08d4f0eaa52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:36 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] Volume volume-10b5d419-5888-417c-95ba-f4e14cdb9920 (10b5d419-5888-417c-95ba-f4e14cdb9920): created successfully Sep 01 08:18:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe68dfbd-cae8-4871-a34f-f08d4f0eaa52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] Flow 'volume_create_manager' (ae0aca1e-7b4b-47a9-895a-271e5f6780f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:18:36 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-888a176d-5938-414d-9f66-f7bf00d6be2f tempest-VolumesGetTest-843812307 None] Created volume successfully. Sep 01 08:18:36 devstack sudo[93658]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e0198da1-248a-4001-bac9-0c5e2a1296ca tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916.0680502e-4b1a-4f3b-8394-575c2b29f547" returned: 0 in 0.450s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-e0198da1-248a-4001-bac9-0c5e2a1296ca tempest-VolumesSnapshotTestJSON-1588965021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:18:36 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0be939-d888-44d6-9631-93cadee6e76f]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:18:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e0198da1-248a-4001-bac9-0c5e2a1296ca tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:36 devstack sudo[93665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916 Sep 01 08:18:36 devstack sudo[93665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:36 devstack sudo[93665]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e0198da1-248a-4001-bac9-0c5e2a1296ca tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916" returned: 0 in 0.543s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e0198da1-248a-4001-bac9-0c5e2a1296ca tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916.0680502e-4b1a-4f3b-8394-575c2b29f547 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:36 devstack sudo[93685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916.0680502e-4b1a-4f3b-8394-575c2b29f547 Sep 01 08:18:36 devstack sudo[93685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3644a53c-8d6a-4d8c-8df6-c50240de26b8 tempest-VolumesGetTest-843812307 None] Acquiring lock "cinder-10b5d419-5888-417c-95ba-f4e14cdb9920-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3644a53c-8d6a-4d8c-8df6-c50240de26b8 tempest-VolumesGetTest-843812307 None] Lock "cinder-10b5d419-5888-417c-95ba-f4e14cdb9920-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3644a53c-8d6a-4d8c-8df6-c50240de26b8 tempest-VolumesGetTest-843812307 None] Acquiring lock "cinder-quobyte-10b5d419-5888-417c-95ba-f4e14cdb9920" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3644a53c-8d6a-4d8c-8df6-c50240de26b8 tempest-VolumesGetTest-843812307 None] Lock "cinder-quobyte-10b5d419-5888-417c-95ba-f4e14cdb9920" acquired by "delete_volume" :: waited 0.021s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:37 devstack sudo[93685]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e0198da1-248a-4001-bac9-0c5e2a1296ca tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916.0680502e-4b1a-4f3b-8394-575c2b29f547" returned: 0 in 0.493s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e0198da1-248a-4001-bac9-0c5e2a1296ca tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916.0680502e-4b1a-4f3b-8394-575c2b29f547 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:37 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d209b7-3bc8-49a9-b2c0-ca03c5ce0767]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:18:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3644a53c-8d6a-4d8c-8df6-c50240de26b8 tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-10b5d419-5888-417c-95ba-f4e14cdb9920 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:37 devstack sudo[93697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916.0680502e-4b1a-4f3b-8394-575c2b29f547 Sep 01 08:18:37 devstack sudo[93697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:37 devstack sudo[93698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-10b5d419-5888-417c-95ba-f4e14cdb9920 Sep 01 08:18:37 devstack sudo[93698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:37 devstack sudo[93697]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e0198da1-248a-4001-bac9-0c5e2a1296ca tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916.0680502e-4b1a-4f3b-8394-575c2b29f547" returned: 0 in 0.436s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e0198da1-248a-4001-bac9-0c5e2a1296ca tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-quobyte-0680502e-4b1a-4f3b-8394-575c2b29f547" released by "_delete_snapshot" :: held 2.108s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e0198da1-248a-4001-bac9-0c5e2a1296ca tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-quobyte-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916" released by "delete_snapshot" :: held 2.186s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:37 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-e0198da1-248a-4001-bac9-0c5e2a1296ca tempest-VolumesSnapshotTestJSON-1588965021 None] Created reservations ['5bafe4d1-c14a-4102-875d-0774730343f8', '819fa43e-5917-40eb-8f33-1c6d0cf768c2', '1cc7894f-0271-4035-985a-f48de552f429', 'ecc5e7a3-3759-41f9-bb94-3a894a8b1305'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:18:37 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-e0198da1-248a-4001-bac9-0c5e2a1296ca tempest-VolumesSnapshotTestJSON-1588965021 None] Delete snapshot completed successfully. Sep 01 08:18:38 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e0198da1-248a-4001-bac9-0c5e2a1296ca tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-0680502e-4b1a-4f3b-8394-575c2b29f547-delete_snapshot" released by "delete_snapshot" :: held 2.564s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:38 devstack sudo[93698]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3644a53c-8d6a-4d8c-8df6-c50240de26b8 tempest-VolumesGetTest-843812307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-10b5d419-5888-417c-95ba-f4e14cdb9920" returned: 0 in 0.721s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3644a53c-8d6a-4d8c-8df6-c50240de26b8 tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-10b5d419-5888-417c-95ba-f4e14cdb9920 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:38 devstack sudo[93706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-10b5d419-5888-417c-95ba-f4e14cdb9920 Sep 01 08:18:38 devstack sudo[93706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:38 devstack sudo[93706]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3644a53c-8d6a-4d8c-8df6-c50240de26b8 tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-10b5d419-5888-417c-95ba-f4e14cdb9920" returned: 0 in 0.323s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:38 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3644a53c-8d6a-4d8c-8df6-c50240de26b8 tempest-VolumesGetTest-843812307 None] Lock "cinder-quobyte-10b5d419-5888-417c-95ba-f4e14cdb9920" released by "delete_volume" :: held 1.115s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:38 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-3644a53c-8d6a-4d8c-8df6-c50240de26b8 tempest-VolumesGetTest-843812307 None] Created reservations ['92aa3cf0-fd66-4186-86b1-f68803f90d4a', '8f0cb7b4-c2ae-4122-aee0-8a36808a72b1', 'e7ba8975-6e42-4ec4-b820-38892870df6d', 'c60a96c2-0df9-43a5-b0ee-55789899c42c'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:18:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3644a53c-8d6a-4d8c-8df6-c50240de26b8 tempest-VolumesGetTest-843812307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3644a53c-8d6a-4d8c-8df6-c50240de26b8 tempest-VolumesGetTest-843812307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3644a53c-8d6a-4d8c-8df6-c50240de26b8 tempest-VolumesGetTest-843812307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:18:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3644a53c-8d6a-4d8c-8df6-c50240de26b8 tempest-VolumesGetTest-843812307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:18:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3644a53c-8d6a-4d8c-8df6-c50240de26b8 tempest-VolumesGetTest-843812307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3644a53c-8d6a-4d8c-8df6-c50240de26b8 tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:38 devstack sudo[93709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:18:38 devstack sudo[93709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:38 devstack sudo[93709]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3644a53c-8d6a-4d8c-8df6-c50240de26b8 tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.316s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:38 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-3644a53c-8d6a-4d8c-8df6-c50240de26b8 tempest-VolumesGetTest-843812307 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:18:38 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-3644a53c-8d6a-4d8c-8df6-c50240de26b8 tempest-VolumesGetTest-843812307 None] Deleted volume successfully. Sep 01 08:18:38 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3644a53c-8d6a-4d8c-8df6-c50240de26b8 tempest-VolumesGetTest-843812307 None] Lock "cinder-10b5d419-5888-417c-95ba-f4e14cdb9920-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:39 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:18:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] Flow 'volume_create_manager' (78af221e-282b-4e80-af8a-e8bebb830603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:18:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a70f065-192f-4212-816d-ab5fa368f365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a70f065-192f-4212-816d-ab5fa368f365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1590344352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d328744-4a60-4919-a281-143ff3e918cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='177f24a70dd44c9a968d7268c68984d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:18:39Z,use_quota=True,user_id='26dcf215534d48e7b958182081bd184a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b0251e0-0253-4b7e-aad2-148b21dc8830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b0251e0-0253-4b7e-aad2-148b21dc8830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81190bb5-05a2-427a-b53f-95a238b7828f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81190bb5-05a2-427a-b53f-95a238b7828f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d328744-4a60-4919-a281-143ff3e918cc', 'volume_name': 'volume-6d328744-4a60-4919-a281-143ff3e918cc', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61adc0d1-f668-452f-ba89-35ab5eefe64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61adc0d1-f668-452f-ba89-35ab5eefe64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1637d2-27a4-4ab8-8c7a-b4cdcf011cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:39 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] Volume 6d328744-4a60-4919-a281-143ff3e918cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d328744-4a60-4919-a281-143ff3e918cc', 'volume_size': 1} Sep 01 08:18:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1590344352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d328744-4a60-4919-a281-143ff3e918cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='177f24a70dd44c9a968d7268c68984d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:18:39Z,use_quota=True,user_id='26dcf215534d48e7b958182081bd184a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:18:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] Creating volume 6d328744-4a60-4919-a281-143ff3e918cc {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:18:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:18:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:18:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:18:39 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:18:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:39 devstack sudo[93712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc 1073741824 Sep 01 08:18:39 devstack sudo[93712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-31c41659-37bf-43d0-bdda-8c6e3c02f334 tempest-VolumesGetTest-843812307 None] Acquiring lock "cinder-109b9cf0-7528-4b29-9a76-40cab1e35c0d-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-31c41659-37bf-43d0-bdda-8c6e3c02f334 tempest-VolumesGetTest-843812307 None] Lock "cinder-109b9cf0-7528-4b29-9a76-40cab1e35c0d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-31c41659-37bf-43d0-bdda-8c6e3c02f334 tempest-VolumesGetTest-843812307 None] Acquiring lock "cinder-quobyte-109b9cf0-7528-4b29-9a76-40cab1e35c0d" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-31c41659-37bf-43d0-bdda-8c6e3c02f334 tempest-VolumesGetTest-843812307 None] Lock "cinder-quobyte-109b9cf0-7528-4b29-9a76-40cab1e35c0d" acquired by "delete_volume" :: waited 0.030s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:39 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fd1935-1d23-400d-8476-62a43dbc1dbc]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:18:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-31c41659-37bf-43d0-bdda-8c6e3c02f334 tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-109b9cf0-7528-4b29-9a76-40cab1e35c0d {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:39 devstack sudo[93714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-109b9cf0-7528-4b29-9a76-40cab1e35c0d Sep 01 08:18:39 devstack sudo[93714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:39 devstack sudo[93712]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc 1073741824" returned: 0 in 0.572s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:40 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc Sep 01 08:18:40 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:40 devstack sudo[93714]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-31c41659-37bf-43d0-bdda-8c6e3c02f334 tempest-VolumesGetTest-843812307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-109b9cf0-7528-4b29-9a76-40cab1e35c0d" returned: 0 in 0.456s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-31c41659-37bf-43d0-bdda-8c6e3c02f334 tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-109b9cf0-7528-4b29-9a76-40cab1e35c0d {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:40 devstack sudo[93725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-109b9cf0-7528-4b29-9a76-40cab1e35c0d Sep 01 08:18:40 devstack sudo[93725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:40 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc" returned: 0 in 0.305s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:40 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:18:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1637d2-27a4-4ab8-8c7a-b4cdcf011cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d328744-4a60-4919-a281-143ff3e918cc', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (088c6562-97cd-4dc0-b271-3b8f959ce66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:40 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] Volume volume-6d328744-4a60-4919-a281-143ff3e918cc (6d328744-4a60-4919-a281-143ff3e918cc): created successfully Sep 01 08:18:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (088c6562-97cd-4dc0-b271-3b8f959ce66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] Flow 'volume_create_manager' (78af221e-282b-4e80-af8a-e8bebb830603) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:18:40 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-093a5bf4-659a-4eb7-968c-d6a99073e07f tempest-VolumesSnapshotTestJSON-1588965021 None] Created volume successfully. Sep 01 08:18:40 devstack sudo[93725]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-31c41659-37bf-43d0-bdda-8c6e3c02f334 tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-109b9cf0-7528-4b29-9a76-40cab1e35c0d" returned: 0 in 0.336s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-31c41659-37bf-43d0-bdda-8c6e3c02f334 tempest-VolumesGetTest-843812307 None] Lock "cinder-quobyte-109b9cf0-7528-4b29-9a76-40cab1e35c0d" released by "delete_volume" :: held 0.851s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:40 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-31c41659-37bf-43d0-bdda-8c6e3c02f334 tempest-VolumesGetTest-843812307 None] Created reservations ['7eed904d-7fbc-4cfb-bc8d-2c16c7f87edb', '22de3983-9c53-49e9-ae14-10cb082107aa', '5f499d6b-4808-4601-85f1-f3023d8ac83d', '4266516b-ea8f-45c6-a6b0-791d61b54347'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:18:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-31c41659-37bf-43d0-bdda-8c6e3c02f334 tempest-VolumesGetTest-843812307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-31c41659-37bf-43d0-bdda-8c6e3c02f334 tempest-VolumesGetTest-843812307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:40 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-31c41659-37bf-43d0-bdda-8c6e3c02f334 tempest-VolumesGetTest-843812307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:18:40 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-31c41659-37bf-43d0-bdda-8c6e3c02f334 tempest-VolumesGetTest-843812307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:18:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-31c41659-37bf-43d0-bdda-8c6e3c02f334 tempest-VolumesGetTest-843812307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-31c41659-37bf-43d0-bdda-8c6e3c02f334 tempest-VolumesGetTest-843812307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:40 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:18:40 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:40 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-31c41659-37bf-43d0-bdda-8c6e3c02f334 tempest-VolumesGetTest-843812307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.342s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:40 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-31c41659-37bf-43d0-bdda-8c6e3c02f334 tempest-VolumesGetTest-843812307 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:18:41 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-31c41659-37bf-43d0-bdda-8c6e3c02f334 tempest-VolumesGetTest-843812307 None] Deleted volume successfully. Sep 01 08:18:41 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-31c41659-37bf-43d0-bdda-8c6e3c02f334 tempest-VolumesGetTest-843812307 None] Lock "cinder-109b9cf0-7528-4b29-9a76-40cab1e35c0d-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d77d0b17-58ab-4444-a368-c942793837fe tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d77d0b17-58ab-4444-a368-c942793837fe tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:41 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-d77d0b17-58ab-4444-a368-c942793837fe tempest-VolumesSnapshotTestJSON-1588965021 None] Creating offline snapshot ceb9892e-241f-482d-b443-7f2c9d2512c8 of volume 6d328744-4a60-4919-a281-143ff3e918cc {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:18:41 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c153640-cf26-4dfd-ac41-6e18c0f2bec9]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:18:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d77d0b17-58ab-4444-a368-c942793837fe tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:41 devstack sudo[93734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc Sep 01 08:18:41 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:42 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d77d0b17-58ab-4444-a368-c942793837fe tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc" returned: 0 in 0.472s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d77d0b17-58ab-4444-a368-c942793837fe tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc.ceb9892e-241f-482d-b443-7f2c9d2512c8 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:42 devstack sudo[93740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc.ceb9892e-241f-482d-b443-7f2c9d2512c8 1G Sep 01 08:18:42 devstack sudo[93740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:42 devstack sudo[93740]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d77d0b17-58ab-4444-a368-c942793837fe tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc.ceb9892e-241f-482d-b443-7f2c9d2512c8 1G" returned: 0 in 0.478s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d77d0b17-58ab-4444-a368-c942793837fe tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d328744-4a60-4919-a281-143ff3e918cc -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc.ceb9892e-241f-482d-b443-7f2c9d2512c8 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:42 devstack sudo[93746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d328744-4a60-4919-a281-143ff3e918cc -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc.ceb9892e-241f-482d-b443-7f2c9d2512c8 Sep 01 08:18:42 devstack sudo[93746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:43 devstack sudo[93746]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d77d0b17-58ab-4444-a368-c942793837fe tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d328744-4a60-4919-a281-143ff3e918cc -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc.ceb9892e-241f-482d-b443-7f2c9d2512c8" returned: 0 in 0.383s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:43 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-d77d0b17-58ab-4444-a368-c942793837fe tempest-VolumesSnapshotTestJSON-1588965021 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc.ceb9892e-241f-482d-b443-7f2c9d2512c8 is being set with open permissions: ugo+rw Sep 01 08:18:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d77d0b17-58ab-4444-a368-c942793837fe tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc.ceb9892e-241f-482d-b443-7f2c9d2512c8 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:43 devstack sudo[93751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc.ceb9892e-241f-482d-b443-7f2c9d2512c8 Sep 01 08:18:43 devstack sudo[93751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:43 devstack sudo[93751]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d77d0b17-58ab-4444-a368-c942793837fe tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc.ceb9892e-241f-482d-b443-7f2c9d2512c8" returned: 0 in 0.266s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d77d0b17-58ab-4444-a368-c942793837fe tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:43 devstack sudo[93754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc.info Sep 01 08:18:43 devstack sudo[93754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:43 devstack sudo[93754]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d77d0b17-58ab-4444-a368-c942793837fe tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc.info" returned: 0 in 0.312s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:43 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-d77d0b17-58ab-4444-a368-c942793837fe tempest-VolumesSnapshotTestJSON-1588965021 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc.info is being set with open permissions: ugo+rw Sep 01 08:18:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d77d0b17-58ab-4444-a368-c942793837fe tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:43 devstack sudo[93760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc.info Sep 01 08:18:43 devstack sudo[93760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:44 devstack sudo[93760]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d77d0b17-58ab-4444-a368-c942793837fe tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc.info" returned: 0 in 0.345s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d77d0b17-58ab-4444-a368-c942793837fe tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.374s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:44 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-d77d0b17-58ab-4444-a368-c942793837fe tempest-VolumesSnapshotTestJSON-1588965021 None] Create snapshot completed successfully Sep 01 08:18:44 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:18:44 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] Flow 'volume_create_manager' (5814ee8a-c864-4c49-9161-2824f6143b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:18:44 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b245c7-a293-461f-95ec-496985fa4797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:44 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b245c7-a293-461f-95ec-496985fa4797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-507649827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd80e961-d387-4da1-b1fa-801716961485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f544eb06f28c45b7b03d6bafd446d17c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:18:45Z,use_quota=True,user_id='c94ebf30154942a1b57055d2700c5db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:44 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b82db86-6216-4937-8f5a-56693371dfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:44 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b82db86-6216-4937-8f5a-56693371dfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:44 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (868381be-015c-40a6-9532-e3ce5b018390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:44 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (868381be-015c-40a6-9532-e3ce5b018390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd80e961-d387-4da1-b1fa-801716961485', 'volume_name': 'volume-cd80e961-d387-4da1-b1fa-801716961485', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:44 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3b52f5d-8e86-4d8e-b0ca-d5edbb3af563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:44 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3b52f5d-8e86-4d8e-b0ca-d5edbb3af563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d9a2c5-f360-443f-a2ce-fc581b79cfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:45 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] Volume cd80e961-d387-4da1-b1fa-801716961485: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd80e961-d387-4da1-b1fa-801716961485', 'volume_size': 1} Sep 01 08:18:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:45 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-507649827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd80e961-d387-4da1-b1fa-801716961485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f544eb06f28c45b7b03d6bafd446d17c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:18:45Z,use_quota=True,user_id='c94ebf30154942a1b57055d2700c5db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:18:45 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] Creating volume cd80e961-d387-4da1-b1fa-801716961485 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:18:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:45 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:18:45 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:18:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:45 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:18:45 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:18:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:45 devstack sudo[93766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485 1073741824 Sep 01 08:18:45 devstack sudo[93766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:45 devstack sudo[93766]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:45 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:18:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485 1073741824" returned: 0 in 0.728s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Flow 'volume_create_manager' (a8688954-9f60-49ff-b6cc-39085284ac1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:18:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab291d0-9fa1-4b9a-9739-a302a9a78c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab291d0-9fa1-4b9a-9739-a302a9a78c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1603383187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df26d1d5-191a-46c9-abe3-5a2154bf91b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='177f24a70dd44c9a968d7268c68984d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:18:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ceb9892e-241f-482d-b443-7f2c9d2512c8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:18:46Z,use_quota=True,user_id='26dcf215534d48e7b958182081bd184a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af12ef7-b00a-4c6b-aebe-2f4050e1af1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af12ef7-b00a-4c6b-aebe-2f4050e1af1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc2e75d-cb71-437a-84eb-e34f304e88d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc2e75d-cb71-437a-84eb-e34f304e88d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'df26d1d5-191a-46c9-abe3-5a2154bf91b5', 'volume_name': 'volume-df26d1d5-191a-46c9-abe3-5a2154bf91b5', 'volume_size': 2, 'snapshot_id': 'ceb9892e-241f-482d-b443-7f2c9d2512c8'}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d66c9a-95fe-4d09-a012-aacde0687ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d66c9a-95fe-4d09-a012-aacde0687ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9fffe2f-839e-4287-85d0-b7d576bad4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:45 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Volume df26d1d5-191a-46c9-abe3-5a2154bf91b5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-df26d1d5-191a-46c9-abe3-5a2154bf91b5', 'volume_size': 2, 'snapshot_id': 'ceb9892e-241f-482d-b443-7f2c9d2512c8'} Sep 01 08:18:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:45 devstack sudo[93772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485 Sep 01 08:18:45 devstack sudo[93772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:46 devstack sudo[93772]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485" returned: 0 in 0.317s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:18:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.309s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:46 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "cinder-quobyte-ceb9892e-241f-482d-b443-7f2c9d2512c8-df26d1d5-191a-46c9-abe3-5a2154bf91b5" by "_create_volume_from_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d9a2c5-f360-443f-a2ce-fc581b79cfdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd80e961-d387-4da1-b1fa-801716961485', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3224a6e1-4653-45c5-88d6-28107b5bceed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:46 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-quobyte-ceb9892e-241f-482d-b443-7f2c9d2512c8-df26d1d5-191a-46c9-abe3-5a2154bf91b5" acquired by "_create_volume_from_snapshot" :: waited 0.058s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Creating volume df26d1d5-191a-46c9-abe3-5a2154bf91b5 from snapshot ceb9892e-241f-482d-b443-7f2c9d2512c8 {{(pid=86893) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 08:18:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:18:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:18:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:18:46 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "cinder-quobyte-df26d1d5-191a-46c9-abe3-5a2154bf91b5" by "_copy_volume_from_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:46 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] Volume volume-cd80e961-d387-4da1-b1fa-801716961485 (cd80e961-d387-4da1-b1fa-801716961485): created successfully Sep 01 08:18:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3224a6e1-4653-45c5-88d6-28107b5bceed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] Flow 'volume_create_manager' (5814ee8a-c864-4c49-9161-2824f6143b27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:18:46 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-6abe5534-1655-4466-b67f-ec7242c8c776 tempest-VolumesSnapshotListTestJSON-2104149951 None] Created volume successfully. Sep 01 08:18:46 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-quobyte-df26d1d5-191a-46c9-abe3-5a2154bf91b5" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] snapshot: ceb9892e-241f-482d-b443-7f2c9d2512c8, volume: df26d1d5-191a-46c9-abe3-5a2154bf91b5, {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 08:18:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:18:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:18:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:46 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6c364f-eeb6-42ed-a033-47e939351949]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:18:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc.ceb9892e-241f-482d-b443-7f2c9d2512c8 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:46 devstack sudo[93786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc.ceb9892e-241f-482d-b443-7f2c9d2512c8 Sep 01 08:18:46 devstack sudo[93786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:46 devstack sudo[93786]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc.ceb9892e-241f-482d-b443-7f2c9d2512c8" returned: 0 in 0.574s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d328744-4a60-4919-a281-143ff3e918cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:18:47 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[840b9735-250f-4292-a9cb-87feb7a44f04]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:18:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:47 devstack sudo[93797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc Sep 01 08:18:47 devstack sudo[93797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-be370618-2e3d-4fb0-8459-6adf95498b3a tempest-VolumesSnapshotListTestJSON-2104149951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:47 devstack sudo[93797]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc" returned: 0 in 0.443s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 08:18:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Creating direct copy from snapshot {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 08:18:47 devstack cinder-volume[86893]: DEBUG cinder.utils [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Path /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-df26d1d5-191a-46c9-abe3-5a2154bf91b5 not found in is_blk_device check {{(pid=86893) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 08:18:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-df26d1d5-191a-46c9-abe3-5a2154bf91b5 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:47 devstack sudo[93803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-df26d1d5-191a-46c9-abe3-5a2154bf91b5 Sep 01 08:18:47 devstack sudo[93803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:54 devstack sudo[93803]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-df26d1d5-191a-46c9-abe3-5a2154bf91b5" returned: 0 in 6.929s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:54 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Image conversion details: src /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc, size 1024.00 MB, duration 6.93 sec, destination /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-df26d1d5-191a-46c9-abe3-5a2154bf91b5 {{(pid=86893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 08:18:54 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Converted 1024.00 MB image at 147.75 MB/s Sep 01 08:18:54 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-df26d1d5-191a-46c9-abe3-5a2154bf91b5 is being set with open permissions: ugo+rw Sep 01 08:18:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-df26d1d5-191a-46c9-abe3-5a2154bf91b5 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:54 devstack sudo[93886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-df26d1d5-191a-46c9-abe3-5a2154bf91b5 Sep 01 08:18:54 devstack sudo[93886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:54 devstack sudo[93886]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-df26d1d5-191a-46c9-abe3-5a2154bf91b5" returned: 0 in 0.276s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:54 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-quobyte-df26d1d5-191a-46c9-abe3-5a2154bf91b5" released by "_copy_volume_from_snapshot" :: held 8.365s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:54 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-quobyte-ceb9892e-241f-482d-b443-7f2c9d2512c8-df26d1d5-191a-46c9-abe3-5a2154bf91b5" released by "_create_volume_from_snapshot" :: held 8.480s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.540s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-be370618-2e3d-4fb0-8459-6adf95498b3a tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.382s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-be370618-2e3d-4fb0-8459-6adf95498b3a tempest-VolumesSnapshotListTestJSON-2104149951 None] Creating offline snapshot eca03b42-8511-4008-8565-c171b083869a of volume cd80e961-d387-4da1-b1fa-801716961485 {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:18:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9fffe2f-839e-4287-85d0-b7d576bad4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df26d1d5-191a-46c9-abe3-5a2154bf91b5', 'volume_size': 2, 'snapshot_id': 'ceb9892e-241f-482d-b443-7f2c9d2512c8'}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59989bae-596b-4195-a3b4-3c70ccc23150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:18:54 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb9502c-a735-480c-b253-827df2fc006b]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:18:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-be370618-2e3d-4fb0-8459-6adf95498b3a tempest-VolumesSnapshotListTestJSON-2104149951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:54 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Volume volume-df26d1d5-191a-46c9-abe3-5a2154bf91b5 (df26d1d5-191a-46c9-abe3-5a2154bf91b5): created successfully Sep 01 08:18:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59989bae-596b-4195-a3b4-3c70ccc23150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:18:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Flow 'volume_create_manager' (a8688954-9f60-49ff-b6cc-39085284ac1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:18:54 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-a16309e4-665c-4391-b2b4-8b137a0ddf50 tempest-VolumesSnapshotTestJSON-1588965021 None] Created volume successfully. Sep 01 08:18:55 devstack sudo[93889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485 Sep 01 08:18:55 devstack sudo[93889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a7587e11-c412-4f22-b6a5-2170c0d22f30 tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "cinder-df26d1d5-191a-46c9-abe3-5a2154bf91b5-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a7587e11-c412-4f22-b6a5-2170c0d22f30 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-df26d1d5-191a-46c9-abe3-5a2154bf91b5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a7587e11-c412-4f22-b6a5-2170c0d22f30 tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "cinder-quobyte-df26d1d5-191a-46c9-abe3-5a2154bf91b5" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a7587e11-c412-4f22-b6a5-2170c0d22f30 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-quobyte-df26d1d5-191a-46c9-abe3-5a2154bf91b5" acquired by "delete_volume" :: waited 0.016s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:55 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[9601f3ad-a935-4b88-ab6b-0563124f4b56]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:18:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a7587e11-c412-4f22-b6a5-2170c0d22f30 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-df26d1d5-191a-46c9-abe3-5a2154bf91b5 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:55 devstack sudo[93891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-df26d1d5-191a-46c9-abe3-5a2154bf91b5 Sep 01 08:18:55 devstack sudo[93891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:55 devstack sudo[93889]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-be370618-2e3d-4fb0-8459-6adf95498b3a tempest-VolumesSnapshotListTestJSON-2104149951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485" returned: 0 in 0.625s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-be370618-2e3d-4fb0-8459-6adf95498b3a tempest-VolumesSnapshotListTestJSON-2104149951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:55 devstack sudo[93896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a 1G Sep 01 08:18:55 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:55 devstack sudo[93891]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a7587e11-c412-4f22-b6a5-2170c0d22f30 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-df26d1d5-191a-46c9-abe3-5a2154bf91b5" returned: 0 in 0.641s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a7587e11-c412-4f22-b6a5-2170c0d22f30 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-df26d1d5-191a-46c9-abe3-5a2154bf91b5 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:55 devstack sudo[93904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-df26d1d5-191a-46c9-abe3-5a2154bf91b5 Sep 01 08:18:55 devstack sudo[93904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:56 devstack sudo[93904]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a7587e11-c412-4f22-b6a5-2170c0d22f30 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-df26d1d5-191a-46c9-abe3-5a2154bf91b5" returned: 0 in 0.375s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:56 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-be370618-2e3d-4fb0-8459-6adf95498b3a tempest-VolumesSnapshotListTestJSON-2104149951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a 1G" returned: 0 in 0.821s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-be370618-2e3d-4fb0-8459-6adf95498b3a tempest-VolumesSnapshotListTestJSON-2104149951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd80e961-d387-4da1-b1fa-801716961485 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a7587e11-c412-4f22-b6a5-2170c0d22f30 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-quobyte-df26d1d5-191a-46c9-abe3-5a2154bf91b5" released by "delete_volume" :: held 1.111s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:56 devstack sudo[93908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd80e961-d387-4da1-b1fa-801716961485 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a Sep 01 08:18:56 devstack sudo[93908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:56 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-a7587e11-c412-4f22-b6a5-2170c0d22f30 tempest-VolumesSnapshotTestJSON-1588965021 None] Created reservations ['56310e9e-1902-4d30-b649-8d73440c26ac', '2c779c27-9311-49cb-bc30-ae9e7d635e53', '24362bbd-1a87-4041-9da3-c17ddde5759b', '66bb1a7e-eaf4-4fe4-9232-25db1ce85ae4'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:18:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a7587e11-c412-4f22-b6a5-2170c0d22f30 tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a7587e11-c412-4f22-b6a5-2170c0d22f30 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:56 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a7587e11-c412-4f22-b6a5-2170c0d22f30 tempest-VolumesSnapshotTestJSON-1588965021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:18:56 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a7587e11-c412-4f22-b6a5-2170c0d22f30 tempest-VolumesSnapshotTestJSON-1588965021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:18:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a7587e11-c412-4f22-b6a5-2170c0d22f30 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a7587e11-c412-4f22-b6a5-2170c0d22f30 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:56 devstack sudo[93910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:18:56 devstack sudo[93910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:56 devstack sudo[93908]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-be370618-2e3d-4fb0-8459-6adf95498b3a tempest-VolumesSnapshotListTestJSON-2104149951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd80e961-d387-4da1-b1fa-801716961485 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a" returned: 0 in 0.530s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:56 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-be370618-2e3d-4fb0-8459-6adf95498b3a tempest-VolumesSnapshotListTestJSON-2104149951 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a is being set with open permissions: ugo+rw Sep 01 08:18:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-be370618-2e3d-4fb0-8459-6adf95498b3a tempest-VolumesSnapshotListTestJSON-2104149951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:56 devstack sudo[93917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a Sep 01 08:18:56 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:56 devstack sudo[93910]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a7587e11-c412-4f22-b6a5-2170c0d22f30 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.352s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:56 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-a7587e11-c412-4f22-b6a5-2170c0d22f30 tempest-VolumesSnapshotTestJSON-1588965021 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:18:56 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-a7587e11-c412-4f22-b6a5-2170c0d22f30 tempest-VolumesSnapshotTestJSON-1588965021 None] Deleted volume successfully. Sep 01 08:18:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a7587e11-c412-4f22-b6a5-2170c0d22f30 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-df26d1d5-191a-46c9-abe3-5a2154bf91b5-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:57 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-be370618-2e3d-4fb0-8459-6adf95498b3a tempest-VolumesSnapshotListTestJSON-2104149951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a" returned: 0 in 0.356s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-be370618-2e3d-4fb0-8459-6adf95498b3a tempest-VolumesSnapshotListTestJSON-2104149951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:57 devstack sudo[93920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.info Sep 01 08:18:57 devstack sudo[93920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:57 devstack sudo[93920]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-be370618-2e3d-4fb0-8459-6adf95498b3a tempest-VolumesSnapshotListTestJSON-2104149951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.info" returned: 0 in 0.358s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:57 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-be370618-2e3d-4fb0-8459-6adf95498b3a tempest-VolumesSnapshotListTestJSON-2104149951 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.info is being set with open permissions: ugo+rw Sep 01 08:18:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-be370618-2e3d-4fb0-8459-6adf95498b3a tempest-VolumesSnapshotListTestJSON-2104149951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bcdaf12d-b9cc-44fd-b1b8-ab4ae18682b2 tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "cinder-ceb9892e-241f-482d-b443-7f2c9d2512c8-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:57 devstack sudo[93924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.info Sep 01 08:18:57 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bcdaf12d-b9cc-44fd-b1b8-ab4ae18682b2 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-ceb9892e-241f-482d-b443-7f2c9d2512c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bcdaf12d-b9cc-44fd-b1b8-ab4ae18682b2 tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "cinder-quobyte-6d328744-4a60-4919-a281-143ff3e918cc" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bcdaf12d-b9cc-44fd-b1b8-ab4ae18682b2 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-quobyte-6d328744-4a60-4919-a281-143ff3e918cc" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bcdaf12d-b9cc-44fd-b1b8-ab4ae18682b2 tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "cinder-quobyte-ceb9892e-241f-482d-b443-7f2c9d2512c8" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:18:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bcdaf12d-b9cc-44fd-b1b8-ab4ae18682b2 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-quobyte-ceb9892e-241f-482d-b443-7f2c9d2512c8" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:18:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-bcdaf12d-b9cc-44fd-b1b8-ab4ae18682b2 tempest-VolumesSnapshotTestJSON-1588965021 None] Deleting offline snapshot ceb9892e-241f-482d-b443-7f2c9d2512c8 of volume 6d328744-4a60-4919-a281-143ff3e918cc {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:18:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-bcdaf12d-b9cc-44fd-b1b8-ab4ae18682b2 tempest-VolumesSnapshotTestJSON-1588965021 None] snapshot_file for this snap is: volume-6d328744-4a60-4919-a281-143ff3e918cc.ceb9892e-241f-482d-b443-7f2c9d2512c8 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:18:57 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1955883-ca16-4aec-85d7-380b461a2838]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:18:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bcdaf12d-b9cc-44fd-b1b8-ab4ae18682b2 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc.ceb9892e-241f-482d-b443-7f2c9d2512c8 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:57 devstack sudo[93926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc.ceb9892e-241f-482d-b443-7f2c9d2512c8 Sep 01 08:18:57 devstack sudo[93926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:58 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-be370618-2e3d-4fb0-8459-6adf95498b3a tempest-VolumesSnapshotListTestJSON-2104149951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.info" returned: 0 in 0.477s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-be370618-2e3d-4fb0-8459-6adf95498b3a tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.320s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:18:58 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-be370618-2e3d-4fb0-8459-6adf95498b3a tempest-VolumesSnapshotListTestJSON-2104149951 None] Create snapshot completed successfully Sep 01 08:18:58 devstack sudo[93926]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bcdaf12d-b9cc-44fd-b1b8-ab4ae18682b2 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc.ceb9892e-241f-482d-b443-7f2c9d2512c8" returned: 0 in 0.466s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-bcdaf12d-b9cc-44fd-b1b8-ab4ae18682b2 tempest-VolumesSnapshotTestJSON-1588965021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d328744-4a60-4919-a281-143ff3e918cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:18:58 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ada0b0-6ae2-485e-aab8-a54fa309e96d]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:18:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bcdaf12d-b9cc-44fd-b1b8-ab4ae18682b2 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:58 devstack sudo[93933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc Sep 01 08:18:58 devstack sudo[93933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:58 devstack sudo[93933]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bcdaf12d-b9cc-44fd-b1b8-ab4ae18682b2 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc" returned: 0 in 0.603s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bcdaf12d-b9cc-44fd-b1b8-ab4ae18682b2 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc.ceb9892e-241f-482d-b443-7f2c9d2512c8 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:58 devstack sudo[93939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc.ceb9892e-241f-482d-b443-7f2c9d2512c8 Sep 01 08:18:58 devstack sudo[93939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:59 devstack sudo[93939]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bcdaf12d-b9cc-44fd-b1b8-ab4ae18682b2 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc.ceb9892e-241f-482d-b443-7f2c9d2512c8" returned: 0 in 0.442s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bcdaf12d-b9cc-44fd-b1b8-ab4ae18682b2 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc.ceb9892e-241f-482d-b443-7f2c9d2512c8 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:59 devstack sudo[93944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc.ceb9892e-241f-482d-b443-7f2c9d2512c8 Sep 01 08:18:59 devstack sudo[93944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-64787adf-8234-47ab-a04f-316f0cf56a6f tempest-VolumesSnapshotListTestJSON-2104149951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:18:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-64787adf-8234-47ab-a04f-316f0cf56a6f tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:18:59 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-64787adf-8234-47ab-a04f-316f0cf56a6f tempest-VolumesSnapshotListTestJSON-2104149951 None] Creating offline snapshot 0f71a459-7a25-4154-b857-26f4d87db251 of volume cd80e961-d387-4da1-b1fa-801716961485 {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:18:59 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[6671e6bb-15ad-4df0-a50b-7e976c236c8c]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:18:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-64787adf-8234-47ab-a04f-316f0cf56a6f tempest-VolumesSnapshotListTestJSON-2104149951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:18:59 devstack sudo[93944]: pam_unix(sudo:session): session closed for user root Sep 01 08:18:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bcdaf12d-b9cc-44fd-b1b8-ab4ae18682b2 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc.ceb9892e-241f-482d-b443-7f2c9d2512c8" returned: 0 in 0.344s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:18:59 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bcdaf12d-b9cc-44fd-b1b8-ab4ae18682b2 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-quobyte-ceb9892e-241f-482d-b443-7f2c9d2512c8" released by "_delete_snapshot" :: held 2.027s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:59 devstack sudo[93946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a Sep 01 08:18:59 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bcdaf12d-b9cc-44fd-b1b8-ab4ae18682b2 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-quobyte-6d328744-4a60-4919-a281-143ff3e918cc" released by "delete_snapshot" :: held 2.097s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:18:59 devstack sudo[93946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:18:59 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-bcdaf12d-b9cc-44fd-b1b8-ab4ae18682b2 tempest-VolumesSnapshotTestJSON-1588965021 None] Created reservations ['4d6c8e4b-d41f-4e2d-8094-df8b93364537', '51918296-b0bd-464a-8019-9138ec0b12ab', '0e8012ee-9c23-477a-9103-56d21cad216f', '7a0433f8-166f-453b-86b7-e8dc205f2ad7'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:18:59 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-bcdaf12d-b9cc-44fd-b1b8-ab4ae18682b2 tempest-VolumesSnapshotTestJSON-1588965021 None] Delete snapshot completed successfully. Sep 01 08:19:00 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bcdaf12d-b9cc-44fd-b1b8-ab4ae18682b2 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-ceb9892e-241f-482d-b443-7f2c9d2512c8-delete_snapshot" released by "delete_snapshot" :: held 2.357s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:19:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-64787adf-8234-47ab-a04f-316f0cf56a6f tempest-VolumesSnapshotListTestJSON-2104149951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a" returned: 0 in 0.532s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:00 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-64787adf-8234-47ab-a04f-316f0cf56a6f tempest-VolumesSnapshotListTestJSON-2104149951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd80e961-d387-4da1-b1fa-801716961485(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:19:00 devstack sudo[93946]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-64787adf-8234-47ab-a04f-316f0cf56a6f tempest-VolumesSnapshotListTestJSON-2104149951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:00 devstack sudo[93952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251 1G Sep 01 08:19:00 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:00 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-64787adf-8234-47ab-a04f-316f0cf56a6f tempest-VolumesSnapshotListTestJSON-2104149951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251 1G" returned: 0 in 0.646s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-64787adf-8234-47ab-a04f-316f0cf56a6f tempest-VolumesSnapshotListTestJSON-2104149951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:00 devstack sudo[93958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251 Sep 01 08:19:00 devstack sudo[93958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:01 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-04eefe4f-1f43-43aa-bbf4-83c4e84c456d tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "cinder-6d328744-4a60-4919-a281-143ff3e918cc-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:19:01 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-04eefe4f-1f43-43aa-bbf4-83c4e84c456d tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-6d328744-4a60-4919-a281-143ff3e918cc-delete_volume" acquired by "delete_volume" :: waited 0.160s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:19:01 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-04eefe4f-1f43-43aa-bbf4-83c4e84c456d tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "cinder-quobyte-6d328744-4a60-4919-a281-143ff3e918cc" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:19:01 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-04eefe4f-1f43-43aa-bbf4-83c4e84c456d tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-quobyte-6d328744-4a60-4919-a281-143ff3e918cc" acquired by "delete_volume" :: waited 0.035s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:19:01 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3450795-eeb0-4e47-9c18-61dad2c2bb0a]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:19:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-04eefe4f-1f43-43aa-bbf4-83c4e84c456d tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:01 devstack sudo[93958]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-64787adf-8234-47ab-a04f-316f0cf56a6f tempest-VolumesSnapshotListTestJSON-2104149951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251" returned: 0 in 0.701s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:01 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-64787adf-8234-47ab-a04f-316f0cf56a6f tempest-VolumesSnapshotListTestJSON-2104149951 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251 is being set with open permissions: ugo+rw Sep 01 08:19:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-64787adf-8234-47ab-a04f-316f0cf56a6f tempest-VolumesSnapshotListTestJSON-2104149951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:01 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc Sep 01 08:19:01 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:01 devstack sudo[93964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251 Sep 01 08:19:01 devstack sudo[93964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:01 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-04eefe4f-1f43-43aa-bbf4-83c4e84c456d tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc" returned: 0 in 0.589s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-04eefe4f-1f43-43aa-bbf4-83c4e84c456d tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:01 devstack sudo[93964]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-64787adf-8234-47ab-a04f-316f0cf56a6f tempest-VolumesSnapshotListTestJSON-2104149951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251" returned: 0 in 0.505s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:02 devstack sudo[93974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc Sep 01 08:19:02 devstack sudo[93974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-64787adf-8234-47ab-a04f-316f0cf56a6f tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.566s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:19:02 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-64787adf-8234-47ab-a04f-316f0cf56a6f tempest-VolumesSnapshotListTestJSON-2104149951 None] Create snapshot completed successfully Sep 01 08:19:02 devstack sudo[93974]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-04eefe4f-1f43-43aa-bbf4-83c4e84c456d tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6d328744-4a60-4919-a281-143ff3e918cc" returned: 0 in 0.598s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:02 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-04eefe4f-1f43-43aa-bbf4-83c4e84c456d tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-quobyte-6d328744-4a60-4919-a281-143ff3e918cc" released by "delete_volume" :: held 1.271s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:19:02 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-04eefe4f-1f43-43aa-bbf4-83c4e84c456d tempest-VolumesSnapshotTestJSON-1588965021 None] Created reservations ['f41d478e-02e7-4ea3-be2d-25a0bd5bc72b', '39f826fe-7cc6-42fe-bfac-9aba5924464f', '9b1b21f1-2a2a-4210-983b-21d9c52450b7', '619bf08b-c934-4dcd-be66-afab458c2100'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:19:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-04eefe4f-1f43-43aa-bbf4-83c4e84c456d tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:19:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-04eefe4f-1f43-43aa-bbf4-83c4e84c456d tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:19:02 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-04eefe4f-1f43-43aa-bbf4-83c4e84c456d tempest-VolumesSnapshotTestJSON-1588965021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:19:02 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-04eefe4f-1f43-43aa-bbf4-83c4e84c456d tempest-VolumesSnapshotTestJSON-1588965021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:19:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-04eefe4f-1f43-43aa-bbf4-83c4e84c456d tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:19:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-04eefe4f-1f43-43aa-bbf4-83c4e84c456d tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:02 devstack sudo[94010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:19:02 devstack sudo[94010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e7cece75-da58-4374-a4c5-a0b698971dda tempest-VolumesSnapshotListTestJSON-2104149951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:19:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e7cece75-da58-4374-a4c5-a0b698971dda tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:19:03 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-e7cece75-da58-4374-a4c5-a0b698971dda tempest-VolumesSnapshotListTestJSON-2104149951 None] Creating offline snapshot 401c89de-c4a2-4999-9178-289fab7729a3 of volume cd80e961-d387-4da1-b1fa-801716961485 {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:19:03 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2456968-9b33-495c-b48a-13a12b20a506]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:19:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e7cece75-da58-4374-a4c5-a0b698971dda tempest-VolumesSnapshotListTestJSON-2104149951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:03 devstack sudo[94010]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-04eefe4f-1f43-43aa-bbf4-83c4e84c456d tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.505s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:03 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-04eefe4f-1f43-43aa-bbf4-83c4e84c456d tempest-VolumesSnapshotTestJSON-1588965021 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:19:03 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-04eefe4f-1f43-43aa-bbf4-83c4e84c456d tempest-VolumesSnapshotTestJSON-1588965021 None] Deleted volume successfully. Sep 01 08:19:03 devstack sudo[94012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251 Sep 01 08:19:03 devstack sudo[94012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:03 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-04eefe4f-1f43-43aa-bbf4-83c4e84c456d tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-6d328744-4a60-4919-a281-143ff3e918cc-delete_volume" released by "delete_volume" :: held 2.201s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:19:03 devstack sudo[94012]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e7cece75-da58-4374-a4c5-a0b698971dda tempest-VolumesSnapshotListTestJSON-2104149951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251" returned: 0 in 0.590s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:03 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-e7cece75-da58-4374-a4c5-a0b698971dda tempest-VolumesSnapshotListTestJSON-2104149951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd80e961-d387-4da1-b1fa-801716961485(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:19:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e7cece75-da58-4374-a4c5-a0b698971dda tempest-VolumesSnapshotListTestJSON-2104149951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.401c89de-c4a2-4999-9178-289fab7729a3 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:03 devstack sudo[94019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.401c89de-c4a2-4999-9178-289fab7729a3 1G Sep 01 08:19:03 devstack sudo[94019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:04 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:19:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] Flow 'volume_create_manager' (47aee9de-e0b1-4085-acfc-c5e2835ec1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:19:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c13a7eb-bc95-4e27-89e3-37e0b0c21060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:19:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c13a7eb-bc95-4e27-89e3-37e0b0c21060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-83629903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=238416f3-e826-4bc9-b54a-440e0aabe612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='177f24a70dd44c9a968d7268c68984d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:19:04Z,use_quota=True,user_id='26dcf215534d48e7b958182081bd184a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:19:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c250f7e8-777b-4198-aeb5-68519e0665ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:19:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c250f7e8-777b-4198-aeb5-68519e0665ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:19:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (613e691f-33fc-4b9a-b996-b560f34a0a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:19:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (613e691f-33fc-4b9a-b996-b560f34a0a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '238416f3-e826-4bc9-b54a-440e0aabe612', 'volume_name': 'volume-238416f3-e826-4bc9-b54a-440e0aabe612', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:19:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8691b845-223f-448e-a14f-26b707abf754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:19:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8691b845-223f-448e-a14f-26b707abf754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:19:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7fa74d-f0d6-415c-a358-1b47f57566f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:19:04 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] Volume 238416f3-e826-4bc9-b54a-440e0aabe612: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-238416f3-e826-4bc9-b54a-440e0aabe612', 'volume_size': 1} Sep 01 08:19:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:19:04 devstack sudo[94019]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e7cece75-da58-4374-a4c5-a0b698971dda tempest-VolumesSnapshotListTestJSON-2104149951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.401c89de-c4a2-4999-9178-289fab7729a3 1G" returned: 0 in 0.673s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e7cece75-da58-4374-a4c5-a0b698971dda tempest-VolumesSnapshotListTestJSON-2104149951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.401c89de-c4a2-4999-9178-289fab7729a3 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:04 devstack sudo[94025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.401c89de-c4a2-4999-9178-289fab7729a3 Sep 01 08:19:04 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:04 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e7cece75-da58-4374-a4c5-a0b698971dda tempest-VolumesSnapshotListTestJSON-2104149951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.401c89de-c4a2-4999-9178-289fab7729a3" returned: 0 in 0.313s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:04 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-e7cece75-da58-4374-a4c5-a0b698971dda tempest-VolumesSnapshotListTestJSON-2104149951 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.401c89de-c4a2-4999-9178-289fab7729a3 is being set with open permissions: ugo+rw Sep 01 08:19:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e7cece75-da58-4374-a4c5-a0b698971dda tempest-VolumesSnapshotListTestJSON-2104149951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.401c89de-c4a2-4999-9178-289fab7729a3 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:04 devstack sudo[94030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.401c89de-c4a2-4999-9178-289fab7729a3 Sep 01 08:19:04 devstack sudo[94030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:05 devstack sudo[94030]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e7cece75-da58-4374-a4c5-a0b698971dda tempest-VolumesSnapshotListTestJSON-2104149951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.401c89de-c4a2-4999-9178-289fab7729a3" returned: 0 in 0.271s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e7cece75-da58-4374-a4c5-a0b698971dda tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:19:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.696s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:19:05 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-83629903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=238416f3-e826-4bc9-b54a-440e0aabe612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='177f24a70dd44c9a968d7268c68984d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:19:04Z,use_quota=True,user_id='26dcf215534d48e7b958182081bd184a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:19:05 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] Creating volume 238416f3-e826-4bc9-b54a-440e0aabe612 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:19:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:19:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:19:05 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:19:05 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:19:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:19:05 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:19:05 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:19:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:05 devstack sudo[94033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612 1073741824 Sep 01 08:19:05 devstack sudo[94033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:05 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-e7cece75-da58-4374-a4c5-a0b698971dda tempest-VolumesSnapshotListTestJSON-2104149951 None] Create snapshot completed successfully Sep 01 08:19:05 devstack sudo[94033]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612 1073741824" returned: 0 in 0.773s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:05 devstack sudo[94054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612 Sep 01 08:19:05 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:06 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-33b2adce-fea2-48e8-9b08-0582225929e7 tempest-VolumesSnapshotListTestJSON-2104149951 None] Acquiring lock "cinder-401c89de-c4a2-4999-9178-289fab7729a3-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:19:06 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:06 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612" returned: 0 in 0.463s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:06 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:19:06 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:19:06 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-33b2adce-fea2-48e8-9b08-0582225929e7 tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "cinder-401c89de-c4a2-4999-9178-289fab7729a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:19:06 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-33b2adce-fea2-48e8-9b08-0582225929e7 tempest-VolumesSnapshotListTestJSON-2104149951 None] Acquiring lock "cinder-quobyte-cd80e961-d387-4da1-b1fa-801716961485" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:19:06 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7fa74d-f0d6-415c-a358-1b47f57566f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-238416f3-e826-4bc9-b54a-440e0aabe612', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:19:06 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be3ad0b1-7dd6-439c-9672-940484c37933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:19:06 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-33b2adce-fea2-48e8-9b08-0582225929e7 tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "cinder-quobyte-cd80e961-d387-4da1-b1fa-801716961485" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:19:06 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-33b2adce-fea2-48e8-9b08-0582225929e7 tempest-VolumesSnapshotListTestJSON-2104149951 None] Acquiring lock "cinder-quobyte-401c89de-c4a2-4999-9178-289fab7729a3" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:19:06 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] Volume volume-238416f3-e826-4bc9-b54a-440e0aabe612 (238416f3-e826-4bc9-b54a-440e0aabe612): created successfully Sep 01 08:19:06 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be3ad0b1-7dd6-439c-9672-940484c37933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:19:06 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] Flow 'volume_create_manager' (47aee9de-e0b1-4085-acfc-c5e2835ec1b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:19:06 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-33b2adce-fea2-48e8-9b08-0582225929e7 tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "cinder-quobyte-401c89de-c4a2-4999-9178-289fab7729a3" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:19:06 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-33b2adce-fea2-48e8-9b08-0582225929e7 tempest-VolumesSnapshotListTestJSON-2104149951 None] Deleting offline snapshot 401c89de-c4a2-4999-9178-289fab7729a3 of volume cd80e961-d387-4da1-b1fa-801716961485 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:19:06 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-33b2adce-fea2-48e8-9b08-0582225929e7 tempest-VolumesSnapshotListTestJSON-2104149951 None] snapshot_file for this snap is: volume-cd80e961-d387-4da1-b1fa-801716961485.401c89de-c4a2-4999-9178-289fab7729a3 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:19:06 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-2c433aae-42f6-4905-86c7-7dc6133bc314 tempest-VolumesSnapshotTestJSON-1588965021 None] Created volume successfully. Sep 01 08:19:06 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[0305f153-c0da-4ea4-9f5f-e0762ead655a]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:19:06 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-33b2adce-fea2-48e8-9b08-0582225929e7 tempest-VolumesSnapshotListTestJSON-2104149951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.401c89de-c4a2-4999-9178-289fab7729a3 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:06 devstack sudo[94057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.401c89de-c4a2-4999-9178-289fab7729a3 Sep 01 08:19:06 devstack sudo[94057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:06 devstack sudo[94057]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:06 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-33b2adce-fea2-48e8-9b08-0582225929e7 tempest-VolumesSnapshotListTestJSON-2104149951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.401c89de-c4a2-4999-9178-289fab7729a3" returned: 0 in 0.416s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:06 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-33b2adce-fea2-48e8-9b08-0582225929e7 tempest-VolumesSnapshotListTestJSON-2104149951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd80e961-d387-4da1-b1fa-801716961485(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:19:06 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b3e029-1b41-47ce-85fd-00deb16ccbc9]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:19:06 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-33b2adce-fea2-48e8-9b08-0582225929e7 tempest-VolumesSnapshotListTestJSON-2104149951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:07 devstack sudo[94063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251 Sep 01 08:19:07 devstack sudo[94063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:07 devstack sudo[94063]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-33b2adce-fea2-48e8-9b08-0582225929e7 tempest-VolumesSnapshotListTestJSON-2104149951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251" returned: 0 in 0.364s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:07 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-33b2adce-fea2-48e8-9b08-0582225929e7 tempest-VolumesSnapshotListTestJSON-2104149951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd80e961-d387-4da1-b1fa-801716961485(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:19:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-33b2adce-fea2-48e8-9b08-0582225929e7 tempest-VolumesSnapshotListTestJSON-2104149951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.401c89de-c4a2-4999-9178-289fab7729a3 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:07 devstack sudo[94068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.401c89de-c4a2-4999-9178-289fab7729a3 Sep 01 08:19:07 devstack sudo[94068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-fc8e9ad5-0a2b-4a6f-a6f9-8d675fe590f5 tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:19:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-fc8e9ad5-0a2b-4a6f-a6f9-8d675fe590f5 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:19:07 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-fc8e9ad5-0a2b-4a6f-a6f9-8d675fe590f5 tempest-VolumesSnapshotTestJSON-1588965021 None] Creating offline snapshot 9dbf73b8-6935-4ab7-a12a-4ce789385656 of volume 238416f3-e826-4bc9-b54a-440e0aabe612 {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:19:07 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38c2663-c50c-4c87-b8eb-e12e95be6e02]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:19:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fc8e9ad5-0a2b-4a6f-a6f9-8d675fe590f5 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:07 devstack sudo[94068]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-33b2adce-fea2-48e8-9b08-0582225929e7 tempest-VolumesSnapshotListTestJSON-2104149951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.401c89de-c4a2-4999-9178-289fab7729a3" returned: 0 in 0.506s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-33b2adce-fea2-48e8-9b08-0582225929e7 tempest-VolumesSnapshotListTestJSON-2104149951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.401c89de-c4a2-4999-9178-289fab7729a3 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:07 devstack sudo[94075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.401c89de-c4a2-4999-9178-289fab7729a3 Sep 01 08:19:07 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:07 devstack sudo[94073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612 Sep 01 08:19:07 devstack sudo[94073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:08 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-33b2adce-fea2-48e8-9b08-0582225929e7 tempest-VolumesSnapshotListTestJSON-2104149951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.401c89de-c4a2-4999-9178-289fab7729a3" returned: 0 in 0.275s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:08 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-33b2adce-fea2-48e8-9b08-0582225929e7 tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "cinder-quobyte-401c89de-c4a2-4999-9178-289fab7729a3" released by "_delete_snapshot" :: held 1.670s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:19:08 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-33b2adce-fea2-48e8-9b08-0582225929e7 tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "cinder-quobyte-cd80e961-d387-4da1-b1fa-801716961485" released by "delete_snapshot" :: held 1.717s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:19:08 devstack sudo[94073]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fc8e9ad5-0a2b-4a6f-a6f9-8d675fe590f5 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612" returned: 0 in 0.441s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fc8e9ad5-0a2b-4a6f-a6f9-8d675fe590f5 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612.9dbf73b8-6935-4ab7-a12a-4ce789385656 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:08 devstack sudo[94082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612.9dbf73b8-6935-4ab7-a12a-4ce789385656 1G Sep 01 08:19:08 devstack sudo[94082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:08 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-33b2adce-fea2-48e8-9b08-0582225929e7 tempest-VolumesSnapshotListTestJSON-2104149951 None] Created reservations ['7f6b4c08-52d2-4bcc-be29-7dbbcde4faa0', '20d5708a-c141-4e10-b5be-d93b575df9f3', '7154c7eb-871b-4efc-92f0-4cf45860500c', '5a6e1599-c110-4dcc-bd86-63019d940c31'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:19:08 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-33b2adce-fea2-48e8-9b08-0582225929e7 tempest-VolumesSnapshotListTestJSON-2104149951 None] Delete snapshot completed successfully. Sep 01 08:19:08 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-33b2adce-fea2-48e8-9b08-0582225929e7 tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "cinder-401c89de-c4a2-4999-9178-289fab7729a3-delete_snapshot" released by "delete_snapshot" :: held 1.900s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:19:08 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-01067a90-f283-4545-910c-c8c45a791626 tempest-VolumesSnapshotListTestJSON-2104149951 None] Acquiring lock "cinder-0f71a459-7a25-4154-b857-26f4d87db251-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:19:08 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-01067a90-f283-4545-910c-c8c45a791626 tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "cinder-0f71a459-7a25-4154-b857-26f4d87db251-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:19:08 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-01067a90-f283-4545-910c-c8c45a791626 tempest-VolumesSnapshotListTestJSON-2104149951 None] Acquiring lock "cinder-quobyte-cd80e961-d387-4da1-b1fa-801716961485" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:19:08 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-01067a90-f283-4545-910c-c8c45a791626 tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "cinder-quobyte-cd80e961-d387-4da1-b1fa-801716961485" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:19:08 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-01067a90-f283-4545-910c-c8c45a791626 tempest-VolumesSnapshotListTestJSON-2104149951 None] Acquiring lock "cinder-quobyte-0f71a459-7a25-4154-b857-26f4d87db251" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:19:08 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-01067a90-f283-4545-910c-c8c45a791626 tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "cinder-quobyte-0f71a459-7a25-4154-b857-26f4d87db251" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:19:08 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-01067a90-f283-4545-910c-c8c45a791626 tempest-VolumesSnapshotListTestJSON-2104149951 None] Deleting offline snapshot 0f71a459-7a25-4154-b857-26f4d87db251 of volume cd80e961-d387-4da1-b1fa-801716961485 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:19:08 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-01067a90-f283-4545-910c-c8c45a791626 tempest-VolumesSnapshotListTestJSON-2104149951 None] snapshot_file for this snap is: volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:19:08 devstack sudo[94082]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fc8e9ad5-0a2b-4a6f-a6f9-8d675fe590f5 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612.9dbf73b8-6935-4ab7-a12a-4ce789385656 1G" returned: 0 in 0.531s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fc8e9ad5-0a2b-4a6f-a6f9-8d675fe590f5 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-238416f3-e826-4bc9-b54a-440e0aabe612 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612.9dbf73b8-6935-4ab7-a12a-4ce789385656 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:08 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[5111824c-07e2-4a07-9a5e-7237cc94ef0d]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:19:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01067a90-f283-4545-910c-c8c45a791626 tempest-VolumesSnapshotListTestJSON-2104149951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:08 devstack sudo[94094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-238416f3-e826-4bc9-b54a-440e0aabe612 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612.9dbf73b8-6935-4ab7-a12a-4ce789385656 Sep 01 08:19:08 devstack sudo[94094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:08 devstack sudo[94095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251 Sep 01 08:19:08 devstack sudo[94095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:09 devstack sudo[94094]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fc8e9ad5-0a2b-4a6f-a6f9-8d675fe590f5 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-238416f3-e826-4bc9-b54a-440e0aabe612 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612.9dbf73b8-6935-4ab7-a12a-4ce789385656" returned: 0 in 0.304s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:09 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-fc8e9ad5-0a2b-4a6f-a6f9-8d675fe590f5 tempest-VolumesSnapshotTestJSON-1588965021 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612.9dbf73b8-6935-4ab7-a12a-4ce789385656 is being set with open permissions: ugo+rw Sep 01 08:19:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fc8e9ad5-0a2b-4a6f-a6f9-8d675fe590f5 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612.9dbf73b8-6935-4ab7-a12a-4ce789385656 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:09 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612.9dbf73b8-6935-4ab7-a12a-4ce789385656 Sep 01 08:19:09 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:09 devstack sudo[94095]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01067a90-f283-4545-910c-c8c45a791626 tempest-VolumesSnapshotListTestJSON-2104149951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251" returned: 0 in 0.393s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:09 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-01067a90-f283-4545-910c-c8c45a791626 tempest-VolumesSnapshotListTestJSON-2104149951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd80e961-d387-4da1-b1fa-801716961485(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:19:09 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[5feb4554-8c19-48b8-a6ad-9bf97be0567e]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:19:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01067a90-f283-4545-910c-c8c45a791626 tempest-VolumesSnapshotListTestJSON-2104149951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:09 devstack sudo[94107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a Sep 01 08:19:09 devstack sudo[94107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:09 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fc8e9ad5-0a2b-4a6f-a6f9-8d675fe590f5 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612.9dbf73b8-6935-4ab7-a12a-4ce789385656" returned: 0 in 0.271s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fc8e9ad5-0a2b-4a6f-a6f9-8d675fe590f5 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:09 devstack sudo[94110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612.info Sep 01 08:19:09 devstack sudo[94110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:09 devstack sudo[94107]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01067a90-f283-4545-910c-c8c45a791626 tempest-VolumesSnapshotListTestJSON-2104149951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a" returned: 0 in 0.411s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:09 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-01067a90-f283-4545-910c-c8c45a791626 tempest-VolumesSnapshotListTestJSON-2104149951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd80e961-d387-4da1-b1fa-801716961485(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:19:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01067a90-f283-4545-910c-c8c45a791626 tempest-VolumesSnapshotListTestJSON-2104149951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:09 devstack sudo[94116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251 Sep 01 08:19:09 devstack sudo[94116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:09 devstack sudo[94110]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fc8e9ad5-0a2b-4a6f-a6f9-8d675fe590f5 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612.info" returned: 0 in 0.294s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:09 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-fc8e9ad5-0a2b-4a6f-a6f9-8d675fe590f5 tempest-VolumesSnapshotTestJSON-1588965021 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612.info is being set with open permissions: ugo+rw Sep 01 08:19:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fc8e9ad5-0a2b-4a6f-a6f9-8d675fe590f5 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:09 devstack sudo[94118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612.info Sep 01 08:19:09 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:09 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fc8e9ad5-0a2b-4a6f-a6f9-8d675fe590f5 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612.info" returned: 0 in 0.270s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-fc8e9ad5-0a2b-4a6f-a6f9-8d675fe590f5 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.214s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:19:09 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-fc8e9ad5-0a2b-4a6f-a6f9-8d675fe590f5 tempest-VolumesSnapshotTestJSON-1588965021 None] Create snapshot completed successfully Sep 01 08:19:10 devstack sudo[94116]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01067a90-f283-4545-910c-c8c45a791626 tempest-VolumesSnapshotListTestJSON-2104149951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251" returned: 0 in 0.452s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01067a90-f283-4545-910c-c8c45a791626 tempest-VolumesSnapshotListTestJSON-2104149951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:10 devstack sudo[94125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251 Sep 01 08:19:10 devstack sudo[94125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:10 devstack sudo[94125]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01067a90-f283-4545-910c-c8c45a791626 tempest-VolumesSnapshotListTestJSON-2104149951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.0f71a459-7a25-4154-b857-26f4d87db251" returned: 0 in 0.258s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:10 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-01067a90-f283-4545-910c-c8c45a791626 tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "cinder-quobyte-0f71a459-7a25-4154-b857-26f4d87db251" released by "_delete_snapshot" :: held 1.646s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:19:10 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-01067a90-f283-4545-910c-c8c45a791626 tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "cinder-quobyte-cd80e961-d387-4da1-b1fa-801716961485" released by "delete_snapshot" :: held 1.677s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:19:10 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-01067a90-f283-4545-910c-c8c45a791626 tempest-VolumesSnapshotListTestJSON-2104149951 None] Created reservations ['f65de451-c22d-4603-9750-fa1b7058b98a', '98916993-c9fa-4e16-a3e5-458419cbae05', 'd981ad71-0910-4cb1-91eb-dba678760877', 'b96cbe69-18ad-42f1-bcfa-a934026f1e98'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:19:10 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-01067a90-f283-4545-910c-c8c45a791626 tempest-VolumesSnapshotListTestJSON-2104149951 None] Delete snapshot completed successfully. Sep 01 08:19:10 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-01067a90-f283-4545-910c-c8c45a791626 tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "cinder-0f71a459-7a25-4154-b857-26f4d87db251-delete_snapshot" released by "delete_snapshot" :: held 1.827s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:19:10 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2a291dd0-6056-4ba4-a4f7-6e67135c0c7d tempest-VolumesSnapshotListTestJSON-2104149951 None] Acquiring lock "cinder-eca03b42-8511-4008-8565-c171b083869a-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:19:10 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2a291dd0-6056-4ba4-a4f7-6e67135c0c7d tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "cinder-eca03b42-8511-4008-8565-c171b083869a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:19:10 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2a291dd0-6056-4ba4-a4f7-6e67135c0c7d tempest-VolumesSnapshotListTestJSON-2104149951 None] Acquiring lock "cinder-quobyte-cd80e961-d387-4da1-b1fa-801716961485" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:19:10 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2a291dd0-6056-4ba4-a4f7-6e67135c0c7d tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "cinder-quobyte-cd80e961-d387-4da1-b1fa-801716961485" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:19:10 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2a291dd0-6056-4ba4-a4f7-6e67135c0c7d tempest-VolumesSnapshotListTestJSON-2104149951 None] Acquiring lock "cinder-quobyte-eca03b42-8511-4008-8565-c171b083869a" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:19:10 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2a291dd0-6056-4ba4-a4f7-6e67135c0c7d tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "cinder-quobyte-eca03b42-8511-4008-8565-c171b083869a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:19:10 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-2a291dd0-6056-4ba4-a4f7-6e67135c0c7d tempest-VolumesSnapshotListTestJSON-2104149951 None] Deleting offline snapshot eca03b42-8511-4008-8565-c171b083869a of volume cd80e961-d387-4da1-b1fa-801716961485 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:19:10 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-2a291dd0-6056-4ba4-a4f7-6e67135c0c7d tempest-VolumesSnapshotListTestJSON-2104149951 None] snapshot_file for this snap is: volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:19:10 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee0195e-8648-4e54-b31d-5ea79ea082ba]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:19:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2a291dd0-6056-4ba4-a4f7-6e67135c0c7d tempest-VolumesSnapshotListTestJSON-2104149951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:11 devstack sudo[94131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a Sep 01 08:19:11 devstack sudo[94131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:11 devstack sudo[94131]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2a291dd0-6056-4ba4-a4f7-6e67135c0c7d tempest-VolumesSnapshotListTestJSON-2104149951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a" returned: 0 in 0.430s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-2a291dd0-6056-4ba4-a4f7-6e67135c0c7d tempest-VolumesSnapshotListTestJSON-2104149951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd80e961-d387-4da1-b1fa-801716961485(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c433a3a-68d9-4161-a857-99f3b7947412]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2a291dd0-6056-4ba4-a4f7-6e67135c0c7d tempest-VolumesSnapshotListTestJSON-2104149951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:11 devstack sudo[94137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485 Sep 01 08:19:11 devstack sudo[94137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Flow 'volume_create_manager' (869ead7f-263b-4363-b131-8590d025e662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71562736-0420-4b3d-b863-78e0817c9d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71562736-0420-4b3d-b863-78e0817c9d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1448939082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b1f681-8bd6-435f-a39d-d1549294ad71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='177f24a70dd44c9a968d7268c68984d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9dbf73b8-6935-4ab7-a12a-4ce789385656,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:19:11Z,use_quota=True,user_id='26dcf215534d48e7b958182081bd184a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d649e6-a261-4de5-8b01-c201913b0d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d649e6-a261-4de5-8b01-c201913b0d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49e6a78e-534c-427e-9bdb-ae8ad2bf2597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49e6a78e-534c-427e-9bdb-ae8ad2bf2597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '98b1f681-8bd6-435f-a39d-d1549294ad71', 'volume_name': 'volume-98b1f681-8bd6-435f-a39d-d1549294ad71', 'volume_size': 1, 'snapshot_id': '9dbf73b8-6935-4ab7-a12a-4ce789385656'}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34729858-a4a0-4e64-b9d5-c8b399b3e584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34729858-a4a0-4e64-b9d5-c8b399b3e584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a2e90c-c937-4956-a33d-47f668042fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:19:11 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Volume 98b1f681-8bd6-435f-a39d-d1549294ad71: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-98b1f681-8bd6-435f-a39d-d1549294ad71', 'volume_size': 1, 'snapshot_id': '9dbf73b8-6935-4ab7-a12a-4ce789385656'} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "cinder-quobyte-9dbf73b8-6935-4ab7-a12a-4ce789385656-98b1f681-8bd6-435f-a39d-d1549294ad71" by "_create_volume_from_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-quobyte-9dbf73b8-6935-4ab7-a12a-4ce789385656-98b1f681-8bd6-435f-a39d-d1549294ad71" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Creating volume 98b1f681-8bd6-435f-a39d-d1549294ad71 from snapshot 9dbf73b8-6935-4ab7-a12a-4ce789385656 {{(pid=86893) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "cinder-quobyte-98b1f681-8bd6-435f-a39d-d1549294ad71" by "_copy_volume_from_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-quobyte-98b1f681-8bd6-435f-a39d-d1549294ad71" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] snapshot: 9dbf73b8-6935-4ab7-a12a-4ce789385656, volume: 98b1f681-8bd6-435f-a39d-d1549294ad71, {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dd03b6-f3c7-4525-90b8-08e7440e60a9]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612.9dbf73b8-6935-4ab7-a12a-4ce789385656 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:11 devstack sudo[94137]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2a291dd0-6056-4ba4-a4f7-6e67135c0c7d tempest-VolumesSnapshotListTestJSON-2104149951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485" returned: 0 in 0.504s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2a291dd0-6056-4ba4-a4f7-6e67135c0c7d tempest-VolumesSnapshotListTestJSON-2104149951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:11 devstack sudo[94143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a Sep 01 08:19:11 devstack sudo[94143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:11 devstack sudo[94142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612.9dbf73b8-6935-4ab7-a12a-4ce789385656 Sep 01 08:19:11 devstack sudo[94142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:12 devstack sudo[94142]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612.9dbf73b8-6935-4ab7-a12a-4ce789385656" returned: 0 in 0.501s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:12 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-238416f3-e826-4bc9-b54a-440e0aabe612(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:19:12 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[7438687f-039c-4f61-89bd-5eb4bcc59a3a]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:19:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:12 devstack sudo[94143]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2a291dd0-6056-4ba4-a4f7-6e67135c0c7d tempest-VolumesSnapshotListTestJSON-2104149951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a" returned: 0 in 0.421s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2a291dd0-6056-4ba4-a4f7-6e67135c0c7d tempest-VolumesSnapshotListTestJSON-2104149951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:12 devstack sudo[94158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a Sep 01 08:19:12 devstack sudo[94158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:12 devstack sudo[94157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612 Sep 01 08:19:12 devstack sudo[94157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:12 devstack sudo[94158]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2a291dd0-6056-4ba4-a4f7-6e67135c0c7d tempest-VolumesSnapshotListTestJSON-2104149951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485.eca03b42-8511-4008-8565-c171b083869a" returned: 0 in 0.300s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:12 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2a291dd0-6056-4ba4-a4f7-6e67135c0c7d tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "cinder-quobyte-eca03b42-8511-4008-8565-c171b083869a" released by "_delete_snapshot" :: held 1.825s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:19:12 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2a291dd0-6056-4ba4-a4f7-6e67135c0c7d tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "cinder-quobyte-cd80e961-d387-4da1-b1fa-801716961485" released by "delete_snapshot" :: held 1.858s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:19:12 devstack sudo[94157]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:12 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-2a291dd0-6056-4ba4-a4f7-6e67135c0c7d tempest-VolumesSnapshotListTestJSON-2104149951 None] Created reservations ['9cd86289-6cff-4f7b-80bb-d4af9a2e410f', '33038b4e-45c0-4198-87a1-a1d06478530e', '93be24f4-b336-47ab-9198-53e92c02bf07', '511c1c4d-7f88-4c5c-9cc4-0184bf287a05'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:19:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612" returned: 0 in 0.524s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:12 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612 {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 08:19:12 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Creating direct copy from snapshot {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 08:19:12 devstack cinder-volume[86893]: DEBUG cinder.utils [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Path /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98b1f681-8bd6-435f-a39d-d1549294ad71 not found in is_blk_device check {{(pid=86893) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 08:19:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98b1f681-8bd6-435f-a39d-d1549294ad71 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:12 devstack sudo[94177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98b1f681-8bd6-435f-a39d-d1549294ad71 Sep 01 08:19:12 devstack sudo[94177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:12 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-2a291dd0-6056-4ba4-a4f7-6e67135c0c7d tempest-VolumesSnapshotListTestJSON-2104149951 None] Delete snapshot completed successfully. Sep 01 08:19:12 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2a291dd0-6056-4ba4-a4f7-6e67135c0c7d tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "cinder-eca03b42-8511-4008-8565-c171b083869a-delete_snapshot" released by "delete_snapshot" :: held 2.134s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:19:13 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8721a60b-86e0-4438-908b-74d3822b1ecc tempest-VolumesSnapshotListTestJSON-2104149951 None] Acquiring lock "cinder-cd80e961-d387-4da1-b1fa-801716961485-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:19:13 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8721a60b-86e0-4438-908b-74d3822b1ecc tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "cinder-cd80e961-d387-4da1-b1fa-801716961485-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:19:13 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8721a60b-86e0-4438-908b-74d3822b1ecc tempest-VolumesSnapshotListTestJSON-2104149951 None] Acquiring lock "cinder-quobyte-cd80e961-d387-4da1-b1fa-801716961485" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:19:13 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8721a60b-86e0-4438-908b-74d3822b1ecc tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "cinder-quobyte-cd80e961-d387-4da1-b1fa-801716961485" acquired by "delete_volume" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:19:13 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e6f181-cc4d-49b3-aafd-506bc45a7d75]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:19:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8721a60b-86e0-4438-908b-74d3822b1ecc tempest-VolumesSnapshotListTestJSON-2104149951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:13 devstack sudo[94182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485 Sep 01 08:19:13 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:14 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8721a60b-86e0-4438-908b-74d3822b1ecc tempest-VolumesSnapshotListTestJSON-2104149951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485" returned: 0 in 0.899s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8721a60b-86e0-4438-908b-74d3822b1ecc tempest-VolumesSnapshotListTestJSON-2104149951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:14 devstack sudo[94194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485 Sep 01 08:19:14 devstack sudo[94194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:14 devstack sudo[94194]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8721a60b-86e0-4438-908b-74d3822b1ecc tempest-VolumesSnapshotListTestJSON-2104149951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd80e961-d387-4da1-b1fa-801716961485" returned: 0 in 0.471s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:14 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8721a60b-86e0-4438-908b-74d3822b1ecc tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "cinder-quobyte-cd80e961-d387-4da1-b1fa-801716961485" released by "delete_volume" :: held 1.474s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:19:14 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:UPDATE=130,cinder:DELETE=11,cinder:SELECT=124,cinder:INSERT=40 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:19:14 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=130,cinder:UPDATE=144,cinder:INSERT=42,cinder:DELETE=13 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:19:14 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-8721a60b-86e0-4438-908b-74d3822b1ecc tempest-VolumesSnapshotListTestJSON-2104149951 None] Created reservations ['137bb756-1002-4f56-9a5e-05c05f64c06b', '60a200ce-7d15-4046-b61c-f471bec4e4ec', '627269a1-0044-41e8-a286-42785554ea25', '0746c825-ba46-41dd-95b2-25d534750dcf'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:19:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8721a60b-86e0-4438-908b-74d3822b1ecc tempest-VolumesSnapshotListTestJSON-2104149951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:19:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8721a60b-86e0-4438-908b-74d3822b1ecc tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:19:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8721a60b-86e0-4438-908b-74d3822b1ecc tempest-VolumesSnapshotListTestJSON-2104149951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:19:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8721a60b-86e0-4438-908b-74d3822b1ecc tempest-VolumesSnapshotListTestJSON-2104149951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:19:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8721a60b-86e0-4438-908b-74d3822b1ecc tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:19:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8721a60b-86e0-4438-908b-74d3822b1ecc tempest-VolumesSnapshotListTestJSON-2104149951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:15 devstack sudo[94197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:19:15 devstack sudo[94197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:15 devstack sudo[94197]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8721a60b-86e0-4438-908b-74d3822b1ecc tempest-VolumesSnapshotListTestJSON-2104149951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.669s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:15 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-8721a60b-86e0-4438-908b-74d3822b1ecc tempest-VolumesSnapshotListTestJSON-2104149951 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:19:15 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-8721a60b-86e0-4438-908b-74d3822b1ecc tempest-VolumesSnapshotListTestJSON-2104149951 None] Deleted volume successfully. Sep 01 08:19:15 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8721a60b-86e0-4438-908b-74d3822b1ecc tempest-VolumesSnapshotListTestJSON-2104149951 None] Lock "cinder-cd80e961-d387-4da1-b1fa-801716961485-delete_volume" released by "delete_volume" :: held 2.769s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:19:20 devstack sudo[94177]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98b1f681-8bd6-435f-a39d-d1549294ad71" returned: 0 in 7.282s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:20 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Image conversion details: src /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612, size 1024.00 MB, duration 7.28 sec, destination /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98b1f681-8bd6-435f-a39d-d1549294ad71 {{(pid=86893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 08:19:20 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Converted 1024.00 MB image at 140.61 MB/s Sep 01 08:19:20 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98b1f681-8bd6-435f-a39d-d1549294ad71 is being set with open permissions: ugo+rw Sep 01 08:19:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98b1f681-8bd6-435f-a39d-d1549294ad71 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:20 devstack sudo[94278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98b1f681-8bd6-435f-a39d-d1549294ad71 Sep 01 08:19:20 devstack sudo[94278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:20 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:19:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] Flow 'volume_create_manager' (013e56e1-fc3d-449e-a629-454d7cd72dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:19:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ffe671e-e762-4792-a313-05f36e44cec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:19:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ffe671e-e762-4792-a313-05f36e44cec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-262396590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=035447a2-cff4-47be-97b3-b978338c7039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5b8d36bbc9648b1a5de9b7029011628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:19:20Z,use_quota=True,user_id='4de653bb2a2f440a9380801d9b9a38fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:19:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cadcefc3-5576-4e72-afa4-58492a61df61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:19:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cadcefc3-5576-4e72-afa4-58492a61df61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:19:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e626687-7217-4b9d-b0d0-0d68e5e7a8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:19:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e626687-7217-4b9d-b0d0-0d68e5e7a8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '035447a2-cff4-47be-97b3-b978338c7039', 'volume_name': 'volume-035447a2-cff4-47be-97b3-b978338c7039', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:19:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03604524-9b57-46b9-bcc4-7f33a8c133f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:19:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03604524-9b57-46b9-bcc4-7f33a8c133f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:19:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d75aa558-df21-423d-8cd7-4a490c0a2833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:19:20 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] Volume 035447a2-cff4-47be-97b3-b978338c7039: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-035447a2-cff4-47be-97b3-b978338c7039', 'volume_size': 1} Sep 01 08:19:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:19:20 devstack sudo[94278]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98b1f681-8bd6-435f-a39d-d1549294ad71" returned: 0 in 0.732s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-quobyte-98b1f681-8bd6-435f-a39d-d1549294ad71" released by "_copy_volume_from_snapshot" :: held 9.157s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:19:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-quobyte-9dbf73b8-6935-4ab7-a12a-4ce789385656-98b1f681-8bd6-435f-a39d-d1549294ad71" released by "_create_volume_from_snapshot" :: held 9.267s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:19:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.284s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:19:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.248s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:19:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-262396590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=035447a2-cff4-47be-97b3-b978338c7039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5b8d36bbc9648b1a5de9b7029011628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:19:20Z,use_quota=True,user_id='4de653bb2a2f440a9380801d9b9a38fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:19:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] Creating volume 035447a2-cff4-47be-97b3-b978338c7039 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:19:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:19:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:19:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:19:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:19:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:19:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:19:20 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:19:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-035447a2-cff4-47be-97b3-b978338c7039 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:21 devstack sudo[94283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-035447a2-cff4-47be-97b3-b978338c7039 1073741824 Sep 01 08:19:21 devstack sudo[94283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a2e90c-c937-4956-a33d-47f668042fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98b1f681-8bd6-435f-a39d-d1549294ad71', 'volume_size': 1, 'snapshot_id': '9dbf73b8-6935-4ab7-a12a-4ce789385656'}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:19:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ad51cbd-f82d-4e49-91b3-c46ac9ddf5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:19:21 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Volume volume-98b1f681-8bd6-435f-a39d-d1549294ad71 (98b1f681-8bd6-435f-a39d-d1549294ad71): created successfully Sep 01 08:19:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ad51cbd-f82d-4e49-91b3-c46ac9ddf5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:19:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Flow 'volume_create_manager' (869ead7f-263b-4363-b131-8590d025e662) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:19:21 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-3bddafbf-ab14-43d6-83b2-e1c02f971389 tempest-VolumesSnapshotTestJSON-1588965021 None] Created volume successfully. Sep 01 08:19:21 devstack sudo[94283]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-035447a2-cff4-47be-97b3-b978338c7039 1073741824" returned: 0 in 0.601s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-035447a2-cff4-47be-97b3-b978338c7039 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:21 devstack sudo[94291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-035447a2-cff4-47be-97b3-b978338c7039 Sep 01 08:19:21 devstack sudo[94291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:22 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-df653012-1931-4021-8429-999afeb1209c tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "cinder-98b1f681-8bd6-435f-a39d-d1549294ad71-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:19:22 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-df653012-1931-4021-8429-999afeb1209c tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-98b1f681-8bd6-435f-a39d-d1549294ad71-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:19:22 devstack sudo[94291]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-035447a2-cff4-47be-97b3-b978338c7039" returned: 0 in 0.453s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:19:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:19:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d75aa558-df21-423d-8cd7-4a490c0a2833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-035447a2-cff4-47be-97b3-b978338c7039', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:19:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b0a30e-599e-40bb-8ac5-44fc252610c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:19:22 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] Volume volume-035447a2-cff4-47be-97b3-b978338c7039 (035447a2-cff4-47be-97b3-b978338c7039): created successfully Sep 01 08:19:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b0a30e-599e-40bb-8ac5-44fc252610c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:19:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] Flow 'volume_create_manager' (013e56e1-fc3d-449e-a629-454d7cd72dbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:19:22 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-df653012-1931-4021-8429-999afeb1209c tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "cinder-quobyte-98b1f681-8bd6-435f-a39d-d1549294ad71" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:19:22 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-250a4023-f16a-4f54-89e5-4fc8974042e1 tempest-AttachVolumeNegativeTest-1390424861 None] Created volume successfully. Sep 01 08:19:22 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-df653012-1931-4021-8429-999afeb1209c tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-quobyte-98b1f681-8bd6-435f-a39d-d1549294ad71" acquired by "delete_volume" :: waited 0.030s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:19:22 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[2577beef-c13c-4ca0-9fbe-09bfb00be834]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:19:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-df653012-1931-4021-8429-999afeb1209c tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98b1f681-8bd6-435f-a39d-d1549294ad71 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:22 devstack sudo[94296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98b1f681-8bd6-435f-a39d-d1549294ad71 Sep 01 08:19:22 devstack sudo[94296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:23 devstack sudo[94296]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-df653012-1931-4021-8429-999afeb1209c tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98b1f681-8bd6-435f-a39d-d1549294ad71" returned: 0 in 1.008s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-df653012-1931-4021-8429-999afeb1209c tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98b1f681-8bd6-435f-a39d-d1549294ad71 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:23 devstack sudo[94317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98b1f681-8bd6-435f-a39d-d1549294ad71 Sep 01 08:19:23 devstack sudo[94317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:23 devstack sudo[94317]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-df653012-1931-4021-8429-999afeb1209c tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98b1f681-8bd6-435f-a39d-d1549294ad71" returned: 0 in 0.596s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:23 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-df653012-1931-4021-8429-999afeb1209c tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-quobyte-98b1f681-8bd6-435f-a39d-d1549294ad71" released by "delete_volume" :: held 1.685s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:19:24 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-df653012-1931-4021-8429-999afeb1209c tempest-VolumesSnapshotTestJSON-1588965021 None] Created reservations ['008463c5-94a9-4343-918b-3a843ae524ae', 'b509e5bc-04d2-4f4a-80d5-af45fe72158d', '5deb5bfb-9597-4bae-92f1-644fde712d6a', '73faf481-d1d0-4b43-b198-0c8833ab6ce3'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:19:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-df653012-1931-4021-8429-999afeb1209c tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:19:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-df653012-1931-4021-8429-999afeb1209c tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:19:24 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-df653012-1931-4021-8429-999afeb1209c tempest-VolumesSnapshotTestJSON-1588965021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:19:24 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-df653012-1931-4021-8429-999afeb1209c tempest-VolumesSnapshotTestJSON-1588965021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:19:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-df653012-1931-4021-8429-999afeb1209c tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:19:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-df653012-1931-4021-8429-999afeb1209c tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-32dd8443-16fa-4df0-be3b-d1855ddd4fa6 req-22474152-1c2c-49a4-825b-900e4d98bbe9 tempest-AttachVolumeNegativeTest-1390424861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:19:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-32dd8443-16fa-4df0-be3b-d1855ddd4fa6 req-22474152-1c2c-49a4-825b-900e4d98bbe9 tempest-AttachVolumeNegativeTest-1390424861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:19:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-32dd8443-16fa-4df0-be3b-d1855ddd4fa6 req-22474152-1c2c-49a4-825b-900e4d98bbe9 tempest-AttachVolumeNegativeTest-1390424861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:19:24 devstack sudo[94330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:19:24 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-32dd8443-16fa-4df0-be3b-d1855ddd4fa6 req-22474152-1c2c-49a4-825b-900e4d98bbe9 tempest-AttachVolumeNegativeTest-1390424861 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049', 'name': 'volume-035447a2-cff4-47be-97b3-b978338c7039', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac8b3636-9315-4c2c-aced-d173f7b2b275', 'enforce_multipath': True} {{(pid=86893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 08:19:24 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-32dd8443-16fa-4df0-be3b-d1855ddd4fa6 req-22474152-1c2c-49a4-825b-900e4d98bbe9 tempest-AttachVolumeNegativeTest-1390424861 None] attachment_update completed successfully. Sep 01 08:19:24 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6d570d6d-c133-450c-9c5c-bf6931d5a011 tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "cinder-9dbf73b8-6935-4ab7-a12a-4ce789385656-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:19:24 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6d570d6d-c133-450c-9c5c-bf6931d5a011 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-9dbf73b8-6935-4ab7-a12a-4ce789385656-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:19:24 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6d570d6d-c133-450c-9c5c-bf6931d5a011 tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "cinder-quobyte-238416f3-e826-4bc9-b54a-440e0aabe612" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:19:24 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-df653012-1931-4021-8429-999afeb1209c tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.691s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:24 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-df653012-1931-4021-8429-999afeb1209c tempest-VolumesSnapshotTestJSON-1588965021 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:19:24 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6d570d6d-c133-450c-9c5c-bf6931d5a011 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-quobyte-238416f3-e826-4bc9-b54a-440e0aabe612" acquired by "delete_snapshot" :: waited 0.091s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:19:24 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6d570d6d-c133-450c-9c5c-bf6931d5a011 tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "cinder-quobyte-9dbf73b8-6935-4ab7-a12a-4ce789385656" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:19:24 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-df653012-1931-4021-8429-999afeb1209c tempest-VolumesSnapshotTestJSON-1588965021 None] Deleted volume successfully. Sep 01 08:19:25 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6d570d6d-c133-450c-9c5c-bf6931d5a011 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-quobyte-9dbf73b8-6935-4ab7-a12a-4ce789385656" acquired by "_delete_snapshot" :: waited 0.066s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:19:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-6d570d6d-c133-450c-9c5c-bf6931d5a011 tempest-VolumesSnapshotTestJSON-1588965021 None] Deleting offline snapshot 9dbf73b8-6935-4ab7-a12a-4ce789385656 of volume 238416f3-e826-4bc9-b54a-440e0aabe612 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:19:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-6d570d6d-c133-450c-9c5c-bf6931d5a011 tempest-VolumesSnapshotTestJSON-1588965021 None] snapshot_file for this snap is: volume-238416f3-e826-4bc9-b54a-440e0aabe612.9dbf73b8-6935-4ab7-a12a-4ce789385656 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:19:25 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-df653012-1931-4021-8429-999afeb1209c tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-98b1f681-8bd6-435f-a39d-d1549294ad71-delete_volume" released by "delete_volume" :: held 3.023s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:19:25 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bed5b1-6fb4-4565-8086-3ad626aa0843]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:19:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6d570d6d-c133-450c-9c5c-bf6931d5a011 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612.9dbf73b8-6935-4ab7-a12a-4ce789385656 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:25 devstack sudo[94399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612.9dbf73b8-6935-4ab7-a12a-4ce789385656 Sep 01 08:19:25 devstack sudo[94399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:25 devstack sudo[94399]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6d570d6d-c133-450c-9c5c-bf6931d5a011 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612.9dbf73b8-6935-4ab7-a12a-4ce789385656" returned: 0 in 0.635s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-6d570d6d-c133-450c-9c5c-bf6931d5a011 tempest-VolumesSnapshotTestJSON-1588965021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-238416f3-e826-4bc9-b54a-440e0aabe612(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:19:25 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f803af-37f1-4014-96a4-de4fd019ec50]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:19:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6d570d6d-c133-450c-9c5c-bf6931d5a011 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:26 devstack sudo[94723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612 Sep 01 08:19:26 devstack sudo[94723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:26 devstack sudo[94723]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6d570d6d-c133-450c-9c5c-bf6931d5a011 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612" returned: 0 in 1.051s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6d570d6d-c133-450c-9c5c-bf6931d5a011 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612.9dbf73b8-6935-4ab7-a12a-4ce789385656 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:26 devstack sudo[94730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612.9dbf73b8-6935-4ab7-a12a-4ce789385656 Sep 01 08:19:26 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:27 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6d570d6d-c133-450c-9c5c-bf6931d5a011 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612.9dbf73b8-6935-4ab7-a12a-4ce789385656" returned: 0 in 0.499s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6d570d6d-c133-450c-9c5c-bf6931d5a011 tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612.9dbf73b8-6935-4ab7-a12a-4ce789385656 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:27 devstack sudo[94736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612.9dbf73b8-6935-4ab7-a12a-4ce789385656 Sep 01 08:19:27 devstack sudo[94736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:27 devstack sudo[94736]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6d570d6d-c133-450c-9c5c-bf6931d5a011 tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612.9dbf73b8-6935-4ab7-a12a-4ce789385656" returned: 0 in 0.353s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:27 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6d570d6d-c133-450c-9c5c-bf6931d5a011 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-quobyte-9dbf73b8-6935-4ab7-a12a-4ce789385656" released by "_delete_snapshot" :: held 2.727s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:19:27 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6d570d6d-c133-450c-9c5c-bf6931d5a011 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-quobyte-238416f3-e826-4bc9-b54a-440e0aabe612" released by "delete_snapshot" :: held 2.808s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:19:27 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-6d570d6d-c133-450c-9c5c-bf6931d5a011 tempest-VolumesSnapshotTestJSON-1588965021 None] Created reservations ['19c0ab60-e58e-4748-892f-5459231a79a1', 'f38ca321-5b8c-4fd6-b8b2-0800f8297dc8', 'ffec13cc-9b26-429b-9e2b-32050642267b', '14035577-bcfc-4580-8991-8e56c39f72fd'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:19:27 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-6d570d6d-c133-450c-9c5c-bf6931d5a011 tempest-VolumesSnapshotTestJSON-1588965021 None] Delete snapshot completed successfully. Sep 01 08:19:27 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6d570d6d-c133-450c-9c5c-bf6931d5a011 tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-9dbf73b8-6935-4ab7-a12a-4ce789385656-delete_snapshot" released by "delete_snapshot" :: held 3.086s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:19:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-dcae3959-ae2f-491e-b848-4f7ee03825fa tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "cinder-238416f3-e826-4bc9-b54a-440e0aabe612-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:19:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-dcae3959-ae2f-491e-b848-4f7ee03825fa tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-238416f3-e826-4bc9-b54a-440e0aabe612-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:19:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-dcae3959-ae2f-491e-b848-4f7ee03825fa tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "cinder-quobyte-238416f3-e826-4bc9-b54a-440e0aabe612" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:19:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-dcae3959-ae2f-491e-b848-4f7ee03825fa tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-quobyte-238416f3-e826-4bc9-b54a-440e0aabe612" acquired by "delete_volume" :: waited 0.028s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:19:28 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[030c52c5-75b6-4921-ac4d-a61779043413]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:19:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-dcae3959-ae2f-491e-b848-4f7ee03825fa tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:28 devstack sudo[94739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612 Sep 01 08:19:28 devstack sudo[94739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:28 devstack sudo[94739]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-dcae3959-ae2f-491e-b848-4f7ee03825fa tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612" returned: 0 in 0.528s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-dcae3959-ae2f-491e-b848-4f7ee03825fa tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:28 devstack sudo[94745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612 Sep 01 08:19:28 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:29 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-dcae3959-ae2f-491e-b848-4f7ee03825fa tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-238416f3-e826-4bc9-b54a-440e0aabe612" returned: 0 in 0.439s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:29 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-dcae3959-ae2f-491e-b848-4f7ee03825fa tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-quobyte-238416f3-e826-4bc9-b54a-440e0aabe612" released by "delete_volume" :: held 1.041s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:19:29 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-dcae3959-ae2f-491e-b848-4f7ee03825fa tempest-VolumesSnapshotTestJSON-1588965021 None] Created reservations ['44dad6e9-acae-4992-a511-4977dca72e87', 'dff44550-4850-42ad-bbac-4a89a7029a48', '59786c98-2e7e-40ed-a169-172a33de2657', 'b3940745-ccb8-4dd6-886c-76d1813a20d7'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:19:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-dcae3959-ae2f-491e-b848-4f7ee03825fa tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:19:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-dcae3959-ae2f-491e-b848-4f7ee03825fa tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:19:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-dcae3959-ae2f-491e-b848-4f7ee03825fa tempest-VolumesSnapshotTestJSON-1588965021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:19:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-dcae3959-ae2f-491e-b848-4f7ee03825fa tempest-VolumesSnapshotTestJSON-1588965021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:19:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-dcae3959-ae2f-491e-b848-4f7ee03825fa tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:19:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-dcae3959-ae2f-491e-b848-4f7ee03825fa tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:29 devstack sudo[94748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:19:29 devstack sudo[94748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:30 devstack sudo[94748]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-dcae3959-ae2f-491e-b848-4f7ee03825fa tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.385s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:30 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-dcae3959-ae2f-491e-b848-4f7ee03825fa tempest-VolumesSnapshotTestJSON-1588965021 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:19:30 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-dcae3959-ae2f-491e-b848-4f7ee03825fa tempest-VolumesSnapshotTestJSON-1588965021 None] Deleted volume successfully. Sep 01 08:19:30 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-dcae3959-ae2f-491e-b848-4f7ee03825fa tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-238416f3-e826-4bc9-b54a-440e0aabe612-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:19:30 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-57f96578-fe87-49a6-b36c-46f836a2208d tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "cinder-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:19:30 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-57f96578-fe87-49a6-b36c-46f836a2208d tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:19:30 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-57f96578-fe87-49a6-b36c-46f836a2208d tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "cinder-quobyte-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:19:30 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-57f96578-fe87-49a6-b36c-46f836a2208d tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-quobyte-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916" acquired by "delete_volume" :: waited 0.023s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:19:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:19:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:19:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:19:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:19:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:19:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:19:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:31 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f03002-b1b5-408e-ac50-360b8f284280]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:19:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-57f96578-fe87-49a6-b36c-46f836a2208d tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:31 devstack sudo[94754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:19:31 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:31 devstack sudo[94755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916 Sep 01 08:19:31 devstack sudo[94755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:31 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.565s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:31 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:19:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager._thread_info {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:19:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread count: 28 {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 08:19:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread info: [<_MainThread(MainThread, started 138934582050944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 08:19:31 devstack sudo[94755]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-57f96578-fe87-49a6-b36c-46f836a2208d tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916" returned: 0 in 0.740s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-57f96578-fe87-49a6-b36c-46f836a2208d tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:31 devstack sudo[94763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916 Sep 01 08:19:31 devstack sudo[94763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:32 devstack sudo[94763]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-57f96578-fe87-49a6-b36c-46f836a2208d tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916" returned: 0 in 0.502s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:32 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-57f96578-fe87-49a6-b36c-46f836a2208d tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-quobyte-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916" released by "delete_volume" :: held 1.386s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:19:32 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-57f96578-fe87-49a6-b36c-46f836a2208d tempest-VolumesSnapshotTestJSON-1588965021 None] Created reservations ['f8e1fad2-8c6a-45e1-9bae-7d04f439e92b', 'd60a9217-d869-4c06-abfa-8fa2709613a6', 'b9ec4557-341a-42a8-ad19-f0c06f065f17', '84771556-6ad8-47cd-90b0-3c1a78839059'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:19:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-57f96578-fe87-49a6-b36c-46f836a2208d tempest-VolumesSnapshotTestJSON-1588965021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:19:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-57f96578-fe87-49a6-b36c-46f836a2208d tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:19:32 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-57f96578-fe87-49a6-b36c-46f836a2208d tempest-VolumesSnapshotTestJSON-1588965021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:19:32 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-57f96578-fe87-49a6-b36c-46f836a2208d tempest-VolumesSnapshotTestJSON-1588965021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:19:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-57f96578-fe87-49a6-b36c-46f836a2208d tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:19:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-57f96578-fe87-49a6-b36c-46f836a2208d tempest-VolumesSnapshotTestJSON-1588965021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:32 devstack sudo[94766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:19:32 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:33 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-57f96578-fe87-49a6-b36c-46f836a2208d tempest-VolumesSnapshotTestJSON-1588965021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.566s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:33 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-57f96578-fe87-49a6-b36c-46f836a2208d tempest-VolumesSnapshotTestJSON-1588965021 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:19:33 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-57f96578-fe87-49a6-b36c-46f836a2208d tempest-VolumesSnapshotTestJSON-1588965021 None] Deleted volume successfully. Sep 01 08:19:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-57f96578-fe87-49a6-b36c-46f836a2208d tempest-VolumesSnapshotTestJSON-1588965021 None] Lock "cinder-e2dc08ec-5c45-46d4-a43d-c6bcd5fa5916-delete_volume" released by "delete_volume" :: held 2.408s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:19:42 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:INSERT=9,cinder:UPDATE=50,cinder:SELECT=30,cinder:DELETE=2 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:19:43 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=37,cinder:INSERT=13,cinder:UPDATE=38,cinder:DELETE=4 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:19:46 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:19:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] Flow 'volume_create_manager' (2f7763f8-9a5d-4db0-ae00-9525c25ff859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:19:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5abb1a1-b87e-47f6-8c30-bac44cf93d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:19:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5abb1a1-b87e-47f6-8c30-bac44cf93d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-528922282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b907e99e-4fc7-40e7-a6d1-b64abcacc2ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b1cc159fd140dab302988a1741d63e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:19:47Z,use_quota=True,user_id='5c502c57d18c44c7a031d8149a6c4f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:19:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60df409-dd9f-4aa7-ad7f-a1e98a3bd841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:19:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60df409-dd9f-4aa7-ad7f-a1e98a3bd841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:19:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43453e3e-d898-498c-8e1e-29f00c3cd8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:19:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43453e3e-d898-498c-8e1e-29f00c3cd8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b907e99e-4fc7-40e7-a6d1-b64abcacc2ee', 'volume_name': 'volume-b907e99e-4fc7-40e7-a6d1-b64abcacc2ee', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:19:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c44f51-3966-434d-951b-13f64f01a66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:19:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c44f51-3966-434d-951b-13f64f01a66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:19:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498f827d-4a6d-4ff5-8838-26ab6e30b68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:19:46 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] Volume b907e99e-4fc7-40e7-a6d1-b64abcacc2ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b907e99e-4fc7-40e7-a6d1-b64abcacc2ee', 'volume_size': 1} Sep 01 08:19:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:19:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:19:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-528922282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b907e99e-4fc7-40e7-a6d1-b64abcacc2ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b1cc159fd140dab302988a1741d63e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:19:47Z,use_quota=True,user_id='5c502c57d18c44c7a031d8149a6c4f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:19:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] Creating volume b907e99e-4fc7-40e7-a6d1-b64abcacc2ee {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:19:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:19:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:19:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:19:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:19:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:19:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:19:46 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:19:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b907e99e-4fc7-40e7-a6d1-b64abcacc2ee 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:46 devstack sudo[94877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b907e99e-4fc7-40e7-a6d1-b64abcacc2ee 1073741824 Sep 01 08:19:46 devstack sudo[94877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:47 devstack sudo[94877]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b907e99e-4fc7-40e7-a6d1-b64abcacc2ee 1073741824" returned: 0 in 0.915s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b907e99e-4fc7-40e7-a6d1-b64abcacc2ee {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:47 devstack sudo[94883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b907e99e-4fc7-40e7-a6d1-b64abcacc2ee Sep 01 08:19:47 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:48 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b907e99e-4fc7-40e7-a6d1-b64abcacc2ee" returned: 0 in 0.445s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:48 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:19:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:19:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498f827d-4a6d-4ff5-8838-26ab6e30b68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b907e99e-4fc7-40e7-a6d1-b64abcacc2ee', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:19:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e41b7c5-ce31-46b3-a3a1-1d42988af6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:19:48 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] Volume volume-b907e99e-4fc7-40e7-a6d1-b64abcacc2ee (b907e99e-4fc7-40e7-a6d1-b64abcacc2ee): created successfully Sep 01 08:19:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e41b7c5-ce31-46b3-a3a1-1d42988af6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:19:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] Flow 'volume_create_manager' (2f7763f8-9a5d-4db0-ae00-9525c25ff859) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:19:48 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-014d0ea9-5f0f-43ec-9ea0-45bf0746ef18 tempest-AttachVolumeTestJSON-1416367693 None] Created volume successfully. Sep 01 08:19:49 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:19:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Flow 'volume_create_manager' (62162644-c514-4c89-b4a4-a04538746d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:19:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (596760ac-4f12-41be-9c46-726b85eb9788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:19:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (596760ac-4f12-41be-9c46-726b85eb9788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1350823042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c38812-ac5c-4164-a553-93d33ce62bc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8565e8277a4d4b5f93e79915cd65f05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:19:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:19:49Z,use_quota=True,user_id='b2b41d3ee4c64908924c9c37e72a83d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:19:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4015b2a8-5a6b-4293-bd84-eb2c5bc9ec07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:19:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4015b2a8-5a6b-4293-bd84-eb2c5bc9ec07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:19:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2552b4f-d59b-440d-9107-6bee03bd65c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:19:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2552b4f-d59b-440d-9107-6bee03bd65c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5c38812-ac5c-4164-a553-93d33ce62bc0', 'volume_name': 'volume-e5c38812-ac5c-4164-a553-93d33ce62bc0', 'volume_size': 2}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:19:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b3fe2c-bbfc-45e3-a139-19c38473b322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:19:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b3fe2c-bbfc-45e3-a139-19c38473b322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:19:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4ef0373-fd8b-4569-8030-6e3d3f9b0e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:19:49 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Volume e5c38812-ac5c-4164-a553-93d33ce62bc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5c38812-ac5c-4164-a553-93d33ce62bc0', 'volume_size': 2} Sep 01 08:19:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:19:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:19:49 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1350823042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c38812-ac5c-4164-a553-93d33ce62bc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8565e8277a4d4b5f93e79915cd65f05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:19:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:19:49Z,use_quota=True,user_id='b2b41d3ee4c64908924c9c37e72a83d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:19:49 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Creating volume e5c38812-ac5c-4164-a553-93d33ce62bc0 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:19:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:19:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:19:49 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:19:49 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:19:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:19:49 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:19:49 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:19:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0 2147483648 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:49 devstack sudo[94891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0 2147483648 Sep 01 08:19:49 devstack sudo[94891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:50 devstack sudo[94891]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0 2147483648" returned: 0 in 1.000s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:50 devstack sudo[94903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0 Sep 01 08:19:50 devstack sudo[94903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-896f2406-1104-40dd-bf46-a8563870853e req-2026db96-33c5-4ba5-8724-bf6abd7313fb tempest-AttachVolumeTestJSON-1416367693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:19:50 devstack sudo[94903]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0" returned: 0 in 0.511s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:50 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:19:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:19:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-896f2406-1104-40dd-bf46-a8563870853e req-2026db96-33c5-4ba5-8724-bf6abd7313fb tempest-AttachVolumeTestJSON-1416367693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.142s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:19:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4ef0373-fd8b-4569-8030-6e3d3f9b0e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5c38812-ac5c-4164-a553-93d33ce62bc0', 'volume_size': 2}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:19:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2843a73-a77c-4c19-8f95-b2b92bcc39e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:19:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-896f2406-1104-40dd-bf46-a8563870853e req-2026db96-33c5-4ba5-8724-bf6abd7313fb tempest-AttachVolumeTestJSON-1416367693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.087s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:19:51 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Volume volume-e5c38812-ac5c-4164-a553-93d33ce62bc0 (e5c38812-ac5c-4164-a553-93d33ce62bc0): created successfully Sep 01 08:19:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2843a73-a77c-4c19-8f95-b2b92bcc39e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:19:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Flow 'volume_create_manager' (62162644-c514-4c89-b4a4-a04538746d89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:19:51 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-1b59fc9c-8983-4a63-8d87-bfa617b77164 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Created volume successfully. Sep 01 08:19:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-896f2406-1104-40dd-bf46-a8563870853e req-2026db96-33c5-4ba5-8724-bf6abd7313fb tempest-AttachVolumeTestJSON-1416367693 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049', 'name': 'volume-b907e99e-4fc7-40e7-a6d1-b64abcacc2ee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6728bc32-4f40-4a91-8836-ab59c561835b', 'enforce_multipath': True} {{(pid=86893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 08:19:51 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-896f2406-1104-40dd-bf46-a8563870853e req-2026db96-33c5-4ba5-8724-bf6abd7313fb tempest-AttachVolumeTestJSON-1416367693 None] attachment_update completed successfully. Sep 01 08:19:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-764b13a4-94c3-40a6-830c-7449dfa278ed tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:19:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-764b13a4-94c3-40a6-830c-7449dfa278ed tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:19:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-764b13a4-94c3-40a6-830c-7449dfa278ed tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Creating offline snapshot aecb1ecb-0479-43a7-b57f-17e8189f3273 of volume e5c38812-ac5c-4164-a553-93d33ce62bc0 {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:19:52 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[4201fa4d-f0d1-44e3-b371-277228adb58b]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:19:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-764b13a4-94c3-40a6-830c-7449dfa278ed tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:52 devstack sudo[94913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0 Sep 01 08:19:52 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:53 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-764b13a4-94c3-40a6-830c-7449dfa278ed tempest-VolumesSnapshotNegativeTestJSON-723381024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0" returned: 0 in 0.561s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-764b13a4-94c3-40a6-830c-7449dfa278ed tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0.aecb1ecb-0479-43a7-b57f-17e8189f3273 2G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:53 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0.aecb1ecb-0479-43a7-b57f-17e8189f3273 2G Sep 01 08:19:53 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:53 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-764b13a4-94c3-40a6-830c-7449dfa278ed tempest-VolumesSnapshotNegativeTestJSON-723381024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0.aecb1ecb-0479-43a7-b57f-17e8189f3273 2G" returned: 0 in 0.664s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-764b13a4-94c3-40a6-830c-7449dfa278ed tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c38812-ac5c-4164-a553-93d33ce62bc0 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0.aecb1ecb-0479-43a7-b57f-17e8189f3273 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:53 devstack sudo[94933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c38812-ac5c-4164-a553-93d33ce62bc0 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0.aecb1ecb-0479-43a7-b57f-17e8189f3273 Sep 01 08:19:53 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:54 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-764b13a4-94c3-40a6-830c-7449dfa278ed tempest-VolumesSnapshotNegativeTestJSON-723381024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c38812-ac5c-4164-a553-93d33ce62bc0 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0.aecb1ecb-0479-43a7-b57f-17e8189f3273" returned: 0 in 0.287s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:54 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-764b13a4-94c3-40a6-830c-7449dfa278ed tempest-VolumesSnapshotNegativeTestJSON-723381024 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0.aecb1ecb-0479-43a7-b57f-17e8189f3273 is being set with open permissions: ugo+rw Sep 01 08:19:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-764b13a4-94c3-40a6-830c-7449dfa278ed tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0.aecb1ecb-0479-43a7-b57f-17e8189f3273 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:54 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0.aecb1ecb-0479-43a7-b57f-17e8189f3273 Sep 01 08:19:54 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:54 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-764b13a4-94c3-40a6-830c-7449dfa278ed tempest-VolumesSnapshotNegativeTestJSON-723381024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0.aecb1ecb-0479-43a7-b57f-17e8189f3273" returned: 0 in 0.270s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-764b13a4-94c3-40a6-830c-7449dfa278ed tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:54 devstack sudo[94941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0.info Sep 01 08:19:54 devstack sudo[94941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:54 devstack sudo[94941]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-764b13a4-94c3-40a6-830c-7449dfa278ed tempest-VolumesSnapshotNegativeTestJSON-723381024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0.info" returned: 0 in 0.384s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:54 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-764b13a4-94c3-40a6-830c-7449dfa278ed tempest-VolumesSnapshotNegativeTestJSON-723381024 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0.info is being set with open permissions: ugo+rw Sep 01 08:19:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-764b13a4-94c3-40a6-830c-7449dfa278ed tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:54 devstack sudo[94944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0.info Sep 01 08:19:54 devstack sudo[94944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:55 devstack sudo[94944]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-764b13a4-94c3-40a6-830c-7449dfa278ed tempest-VolumesSnapshotNegativeTestJSON-723381024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0.info" returned: 0 in 0.344s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-764b13a4-94c3-40a6-830c-7449dfa278ed tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.656s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:19:55 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-764b13a4-94c3-40a6-830c-7449dfa278ed tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Create snapshot completed successfully Sep 01 08:19:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-777d0f40-10e8-4ece-99ea-fd3e451bb222 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Acquiring lock "cinder-aecb1ecb-0479-43a7-b57f-17e8189f3273-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:19:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-777d0f40-10e8-4ece-99ea-fd3e451bb222 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Lock "cinder-aecb1ecb-0479-43a7-b57f-17e8189f3273-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:19:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-777d0f40-10e8-4ece-99ea-fd3e451bb222 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Acquiring lock "cinder-quobyte-e5c38812-ac5c-4164-a553-93d33ce62bc0" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:19:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-777d0f40-10e8-4ece-99ea-fd3e451bb222 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Lock "cinder-quobyte-e5c38812-ac5c-4164-a553-93d33ce62bc0" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:19:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-777d0f40-10e8-4ece-99ea-fd3e451bb222 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Acquiring lock "cinder-quobyte-aecb1ecb-0479-43a7-b57f-17e8189f3273" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:19:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-777d0f40-10e8-4ece-99ea-fd3e451bb222 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Lock "cinder-quobyte-aecb1ecb-0479-43a7-b57f-17e8189f3273" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:19:56 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-777d0f40-10e8-4ece-99ea-fd3e451bb222 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Deleting offline snapshot aecb1ecb-0479-43a7-b57f-17e8189f3273 of volume e5c38812-ac5c-4164-a553-93d33ce62bc0 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:19:56 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-777d0f40-10e8-4ece-99ea-fd3e451bb222 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] snapshot_file for this snap is: volume-e5c38812-ac5c-4164-a553-93d33ce62bc0.aecb1ecb-0479-43a7-b57f-17e8189f3273 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:19:56 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a982434-3ff9-48e1-80c9-0fa3981f39bd]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:19:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-777d0f40-10e8-4ece-99ea-fd3e451bb222 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0.aecb1ecb-0479-43a7-b57f-17e8189f3273 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:56 devstack sudo[94952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0.aecb1ecb-0479-43a7-b57f-17e8189f3273 Sep 01 08:19:56 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:57 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-777d0f40-10e8-4ece-99ea-fd3e451bb222 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0.aecb1ecb-0479-43a7-b57f-17e8189f3273" returned: 0 in 1.023s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-777d0f40-10e8-4ece-99ea-fd3e451bb222 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5c38812-ac5c-4164-a553-93d33ce62bc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:19:57 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[9723e147-f4d9-452b-b33f-cc6433cc7275]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:19:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-777d0f40-10e8-4ece-99ea-fd3e451bb222 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:57 devstack sudo[94977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0 Sep 01 08:19:57 devstack sudo[94977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:57 devstack sudo[94977]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-777d0f40-10e8-4ece-99ea-fd3e451bb222 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0" returned: 0 in 0.624s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-777d0f40-10e8-4ece-99ea-fd3e451bb222 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0.aecb1ecb-0479-43a7-b57f-17e8189f3273 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:57 devstack sudo[94993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0.aecb1ecb-0479-43a7-b57f-17e8189f3273 Sep 01 08:19:57 devstack sudo[94993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:58 devstack sudo[94993]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-777d0f40-10e8-4ece-99ea-fd3e451bb222 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0.aecb1ecb-0479-43a7-b57f-17e8189f3273" returned: 0 in 0.860s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-777d0f40-10e8-4ece-99ea-fd3e451bb222 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0.aecb1ecb-0479-43a7-b57f-17e8189f3273 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:19:58 devstack sudo[95058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0.aecb1ecb-0479-43a7-b57f-17e8189f3273 Sep 01 08:19:58 devstack sudo[95058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:19:59 devstack sudo[95058]: pam_unix(sudo:session): session closed for user root Sep 01 08:19:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-777d0f40-10e8-4ece-99ea-fd3e451bb222 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0.aecb1ecb-0479-43a7-b57f-17e8189f3273" returned: 0 in 0.609s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:19:59 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-777d0f40-10e8-4ece-99ea-fd3e451bb222 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Lock "cinder-quobyte-aecb1ecb-0479-43a7-b57f-17e8189f3273" released by "_delete_snapshot" :: held 3.308s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:19:59 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-777d0f40-10e8-4ece-99ea-fd3e451bb222 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Lock "cinder-quobyte-e5c38812-ac5c-4164-a553-93d33ce62bc0" released by "delete_snapshot" :: held 3.342s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:19:59 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-777d0f40-10e8-4ece-99ea-fd3e451bb222 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Created reservations ['2fe21e94-877b-4747-8645-b95053fe2f4f', '87028b0e-0729-478c-9bea-280ba5ce8135', 'fec8e25c-b36d-443d-a7a7-f63401168339', 'e5f208bd-b537-42ad-b66b-bb3f455f61da'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:19:59 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-777d0f40-10e8-4ece-99ea-fd3e451bb222 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Delete snapshot completed successfully. Sep 01 08:19:59 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-777d0f40-10e8-4ece-99ea-fd3e451bb222 tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Lock "cinder-aecb1ecb-0479-43a7-b57f-17e8189f3273-delete_snapshot" released by "delete_snapshot" :: held 3.602s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:20:00 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-82aaf35a-c6c8-48f2-a23a-af5f81d7cffe tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Acquiring lock "cinder-e5c38812-ac5c-4164-a553-93d33ce62bc0-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:20:00 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-82aaf35a-c6c8-48f2-a23a-af5f81d7cffe tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Lock "cinder-e5c38812-ac5c-4164-a553-93d33ce62bc0-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:20:00 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-82aaf35a-c6c8-48f2-a23a-af5f81d7cffe tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Acquiring lock "cinder-quobyte-e5c38812-ac5c-4164-a553-93d33ce62bc0" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:20:00 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-82aaf35a-c6c8-48f2-a23a-af5f81d7cffe tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Lock "cinder-quobyte-e5c38812-ac5c-4164-a553-93d33ce62bc0" acquired by "delete_volume" :: waited 0.015s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:20:00 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[716bd1a4-7901-4245-8357-9a67ea7f6342]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:20:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-82aaf35a-c6c8-48f2-a23a-af5f81d7cffe tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:20:00 devstack sudo[95105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0 Sep 01 08:20:00 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:20:01 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root Sep 01 08:20:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-82aaf35a-c6c8-48f2-a23a-af5f81d7cffe tempest-VolumesSnapshotNegativeTestJSON-723381024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0" returned: 0 in 0.452s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:20:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-82aaf35a-c6c8-48f2-a23a-af5f81d7cffe tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:20:01 devstack sudo[95112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0 Sep 01 08:20:01 devstack sudo[95112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:20:01 devstack sudo[95112]: pam_unix(sudo:session): session closed for user root Sep 01 08:20:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-82aaf35a-c6c8-48f2-a23a-af5f81d7cffe tempest-VolumesSnapshotNegativeTestJSON-723381024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e5c38812-ac5c-4164-a553-93d33ce62bc0" returned: 0 in 0.319s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:20:01 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-82aaf35a-c6c8-48f2-a23a-af5f81d7cffe tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Lock "cinder-quobyte-e5c38812-ac5c-4164-a553-93d33ce62bc0" released by "delete_volume" :: held 0.842s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:20:01 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-82aaf35a-c6c8-48f2-a23a-af5f81d7cffe tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Created reservations ['f9c97425-8410-49cf-88db-5d288bf97bea', '2fcbfb2f-d928-442e-bdac-041a195651a1', '7bb445ae-c537-4eaa-b066-927498b25a1a', '00eda844-4153-424a-a490-aa6be11f6f38'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:20:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-82aaf35a-c6c8-48f2-a23a-af5f81d7cffe tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:20:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-82aaf35a-c6c8-48f2-a23a-af5f81d7cffe tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:20:01 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-82aaf35a-c6c8-48f2-a23a-af5f81d7cffe tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:20:01 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-82aaf35a-c6c8-48f2-a23a-af5f81d7cffe tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:20:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-82aaf35a-c6c8-48f2-a23a-af5f81d7cffe tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:20:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-82aaf35a-c6c8-48f2-a23a-af5f81d7cffe tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:20:01 devstack sudo[95116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:20:01 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:20:02 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root Sep 01 08:20:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-82aaf35a-c6c8-48f2-a23a-af5f81d7cffe tempest-VolumesSnapshotNegativeTestJSON-723381024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.350s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:20:02 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-82aaf35a-c6c8-48f2-a23a-af5f81d7cffe tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:20:02 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-82aaf35a-c6c8-48f2-a23a-af5f81d7cffe tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Deleted volume successfully. Sep 01 08:20:02 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-82aaf35a-c6c8-48f2-a23a-af5f81d7cffe tempest-VolumesSnapshotNegativeTestJSON-723381024 None] Lock "cinder-e5c38812-ac5c-4164-a553-93d33ce62bc0-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:20:11 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:UPDATE=25,cinder:SELECT=25,cinder:INSERT=4 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:20:12 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=24,cinder:UPDATE=20,cinder:INSERT=7,cinder:DELETE=4 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:20:21 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-756305b6-021a-497b-a690-0fd70832a739 req-43f38859-aefd-46a4-b4ba-2b4b764a170c tempest-AttachVolumeNegativeTest-1390424861 None] Terminate volume connection completed successfully. Sep 01 08:20:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-756305b6-021a-497b-a690-0fd70832a739 req-43f38859-aefd-46a4-b4ba-2b4b764a170c tempest-AttachVolumeNegativeTest-1390424861 None] Deleting attachment ac8b3636-9315-4c2c-aced-d173f7b2b275. {{(pid=86893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:20:31 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:20:31 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] Flow 'volume_create_manager' (85774f51-db23-4f98-b124-550bce3b7c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a186980b-d68d-491d-bde7-f8b7a6c0386f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a186980b-d68d-491d-bde7-f8b7a6c0386f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2113623545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de9a9e63-5867-42cb-9d18-bfbfa05e4875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3deca31a433e4c159d8abd6b6a5a595b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:20:31Z,use_quota=True,user_id='2a66f2ebe62c45398db77dd6fbbf2643',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d2c362-60c0-45ee-974a-91a343d9b665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d2c362-60c0-45ee-974a-91a343d9b665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a376762f-e44a-42c8-a239-59cc4ae5947c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a376762f-e44a-42c8-a239-59cc4ae5947c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de9a9e63-5867-42cb-9d18-bfbfa05e4875', 'volume_name': 'volume-de9a9e63-5867-42cb-9d18-bfbfa05e4875', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdeab8d1-7f0c-4ccf-9958-ec5e0a92374e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdeab8d1-7f0c-4ccf-9958-ec5e0a92374e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c454597-e1b1-4552-a274-125dff55e23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:20:31 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] Volume de9a9e63-5867-42cb-9d18-bfbfa05e4875: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de9a9e63-5867-42cb-9d18-bfbfa05e4875', 'volume_size': 1} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2113623545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de9a9e63-5867-42cb-9d18-bfbfa05e4875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3deca31a433e4c159d8abd6b6a5a595b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:20:31Z,use_quota=True,user_id='2a66f2ebe62c45398db77dd6fbbf2643',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] Creating volume de9a9e63-5867-42cb-9d18-bfbfa05e4875 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:20:31 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-de9a9e63-5867-42cb-9d18-bfbfa05e4875 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:20:31 devstack sudo[95349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-de9a9e63-5867-42cb-9d18-bfbfa05e4875 1073741824 Sep 01 08:20:31 devstack sudo[95349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:20:31 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.407s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager._thread_info {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread count: 28 {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread info: [<_MainThread(MainThread, started 138934582050944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] Flow 'volume_create_manager' (2999f415-237b-470a-a1d4-4de8bfe11bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b18c0f0-8061-4d70-b8d7-b1de4bab3cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b18c0f0-8061-4d70-b8d7-b1de4bab3cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-675828633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14019b2c-6dce-4733-80a0-4e0d0ee7e8fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3deca31a433e4c159d8abd6b6a5a595b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:20:32Z,use_quota=True,user_id='2a66f2ebe62c45398db77dd6fbbf2643',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (945233f3-d089-4bc9-aaca-4115e6284788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (945233f3-d089-4bc9-aaca-4115e6284788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177eb576-759c-4c37-9b01-ba9e83e94e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177eb576-759c-4c37-9b01-ba9e83e94e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14019b2c-6dce-4733-80a0-4e0d0ee7e8fd', 'volume_name': 'volume-14019b2c-6dce-4733-80a0-4e0d0ee7e8fd', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2015836c-a311-4ed9-88fd-e2e07d7f5e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2015836c-a311-4ed9-88fd-e2e07d7f5e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d25137fb-498f-4adf-9106-75fdd00703f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:20:31 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] Volume 14019b2c-6dce-4733-80a0-4e0d0ee7e8fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14019b2c-6dce-4733-80a0-4e0d0ee7e8fd', 'volume_size': 1} Sep 01 08:20:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:20:32 devstack sudo[95349]: pam_unix(sudo:session): session closed for user root Sep 01 08:20:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-de9a9e63-5867-42cb-9d18-bfbfa05e4875 1073741824" returned: 0 in 0.859s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:20:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-de9a9e63-5867-42cb-9d18-bfbfa05e4875 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:20:32 devstack sudo[95359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-de9a9e63-5867-42cb-9d18-bfbfa05e4875 Sep 01 08:20:32 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:20:32 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root Sep 01 08:20:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-de9a9e63-5867-42cb-9d18-bfbfa05e4875" returned: 0 in 0.343s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:20:32 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:20:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:20:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.736s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:20:32 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-675828633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14019b2c-6dce-4733-80a0-4e0d0ee7e8fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3deca31a433e4c159d8abd6b6a5a595b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:20:32Z,use_quota=True,user_id='2a66f2ebe62c45398db77dd6fbbf2643',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:20:32 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] Creating volume 14019b2c-6dce-4733-80a0-4e0d0ee7e8fd {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:20:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:20:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:20:32 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:20:32 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:20:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:20:32 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:20:32 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:20:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-14019b2c-6dce-4733-80a0-4e0d0ee7e8fd 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:20:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c454597-e1b1-4552-a274-125dff55e23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de9a9e63-5867-42cb-9d18-bfbfa05e4875', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:20:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a11095ee-f7eb-480c-8fcf-6f24a0903fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:20:32 devstack sudo[95363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-14019b2c-6dce-4733-80a0-4e0d0ee7e8fd 1073741824 Sep 01 08:20:32 devstack sudo[95363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:20:32 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] Volume volume-de9a9e63-5867-42cb-9d18-bfbfa05e4875 (de9a9e63-5867-42cb-9d18-bfbfa05e4875): created successfully Sep 01 08:20:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a11095ee-f7eb-480c-8fcf-6f24a0903fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:20:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] Flow 'volume_create_manager' (85774f51-db23-4f98-b124-550bce3b7c59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:20:32 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-ae441183-cd8c-404c-b83d-7285f762cb8a tempest-TestServerVolumeAttachmentScenario-119956435 None] Created volume successfully. Sep 01 08:20:32 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:20:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Flow 'volume_create_manager' (8a119013-1b1e-419a-9571-f6d52bf66ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:20:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22b03fe4-cb02-4074-b77b-de48565b4a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:20:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22b03fe4-cb02-4074-b77b-de48565b4a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1586802570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=779950c9-fbd7-4b19-946b-745c11ec48f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4fe5c2767d44852bd221f39b004bed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:20:33Z,use_quota=True,user_id='913883d222234073816fe47c2d92b875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:20:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb604f6-804e-4203-8bad-79a344fe354e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:20:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb604f6-804e-4203-8bad-79a344fe354e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:20:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f06918-4f80-4142-afa8-f8d2486be5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:20:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f06918-4f80-4142-afa8-f8d2486be5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '779950c9-fbd7-4b19-946b-745c11ec48f3', 'volume_name': 'volume-779950c9-fbd7-4b19-946b-745c11ec48f3', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:20:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af574e9f-ecc9-4a28-824a-c2b87267a9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:20:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af574e9f-ecc9-4a28-824a-c2b87267a9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:20:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae34ea8-6139-41f0-bf07-982962edc69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:20:32 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Volume 779950c9-fbd7-4b19-946b-745c11ec48f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-779950c9-fbd7-4b19-946b-745c11ec48f3', 'volume_size': 1} Sep 01 08:20:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:20:33 devstack sudo[95363]: pam_unix(sudo:session): session closed for user root Sep 01 08:20:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-14019b2c-6dce-4733-80a0-4e0d0ee7e8fd 1073741824" returned: 0 in 0.657s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:20:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-14019b2c-6dce-4733-80a0-4e0d0ee7e8fd {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:20:33 devstack sudo[95369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-14019b2c-6dce-4733-80a0-4e0d0ee7e8fd Sep 01 08:20:33 devstack sudo[95369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:20:33 devstack sudo[95369]: pam_unix(sudo:session): session closed for user root Sep 01 08:20:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-14019b2c-6dce-4733-80a0-4e0d0ee7e8fd" returned: 0 in 0.290s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:20:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:20:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:20:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.705s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:20:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1586802570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=779950c9-fbd7-4b19-946b-745c11ec48f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4fe5c2767d44852bd221f39b004bed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:20:33Z,use_quota=True,user_id='913883d222234073816fe47c2d92b875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:20:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Creating volume 779950c9-fbd7-4b19-946b-745c11ec48f3 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:20:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:20:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:20:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:20:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:20:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:20:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:20:33 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:20:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-779950c9-fbd7-4b19-946b-745c11ec48f3 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:20:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d25137fb-498f-4adf-9106-75fdd00703f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14019b2c-6dce-4733-80a0-4e0d0ee7e8fd', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:20:33 devstack sudo[95372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-779950c9-fbd7-4b19-946b-745c11ec48f3 1073741824 Sep 01 08:20:33 devstack sudo[95372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:20:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c7ed63-dd47-47da-a266-074e0e746f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:20:33 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] Volume volume-14019b2c-6dce-4733-80a0-4e0d0ee7e8fd (14019b2c-6dce-4733-80a0-4e0d0ee7e8fd): created successfully Sep 01 08:20:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c7ed63-dd47-47da-a266-074e0e746f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:20:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] Flow 'volume_create_manager' (2999f415-237b-470a-a1d4-4de8bfe11bdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:20:33 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-63fd64e1-10d3-4d20-988e-c8be8c7448e0 tempest-TestServerVolumeAttachmentScenario-119956435 None] Created volume successfully. Sep 01 08:20:34 devstack sudo[95372]: pam_unix(sudo:session): session closed for user root Sep 01 08:20:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-779950c9-fbd7-4b19-946b-745c11ec48f3 1073741824" returned: 0 in 0.547s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:20:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-779950c9-fbd7-4b19-946b-745c11ec48f3 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:20:34 devstack sudo[95389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-779950c9-fbd7-4b19-946b-745c11ec48f3 Sep 01 08:20:34 devstack sudo[95389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:20:34 devstack sudo[95389]: pam_unix(sudo:session): session closed for user root Sep 01 08:20:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-779950c9-fbd7-4b19-946b-745c11ec48f3" returned: 0 in 0.329s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:20:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:20:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:20:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae34ea8-6139-41f0-bf07-982962edc69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-779950c9-fbd7-4b19-946b-745c11ec48f3', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:20:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebc83d6f-0075-4c5a-b307-b7752915ccc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:20:34 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Volume volume-779950c9-fbd7-4b19-946b-745c11ec48f3 (779950c9-fbd7-4b19-946b-745c11ec48f3): created successfully Sep 01 08:20:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebc83d6f-0075-4c5a-b307-b7752915ccc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:20:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Flow 'volume_create_manager' (8a119013-1b1e-419a-9571-f6d52bf66ca3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:20:34 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-d0e9cf7d-c6d1-4e4a-83ba-171043f9e810 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Created volume successfully. Sep 01 08:20:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-e3cf9bd0-b370-4676-95e5-bee22990f7a9 req-820b928a-9ca1-475f-8c6e-b3b1c45eefe1 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:20:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-e3cf9bd0-b370-4676-95e5-bee22990f7a9 req-820b928a-9ca1-475f-8c6e-b3b1c45eefe1 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:20:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-e3cf9bd0-b370-4676-95e5-bee22990f7a9 req-820b928a-9ca1-475f-8c6e-b3b1c45eefe1 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:20:35 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-e3cf9bd0-b370-4676-95e5-bee22990f7a9 req-820b928a-9ca1-475f-8c6e-b3b1c45eefe1 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049', 'name': 'volume-779950c9-fbd7-4b19-946b-745c11ec48f3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a9813a89-7d59-4806-9b70-612bf36ee9ab', 'enforce_multipath': True} {{(pid=86893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 08:20:36 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-e3cf9bd0-b370-4676-95e5-bee22990f7a9 req-820b928a-9ca1-475f-8c6e-b3b1c45eefe1 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] attachment_update completed successfully. Sep 01 08:20:39 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-671d6a4a-35ae-4f3f-b823-cdf8376d29a6 req-705d7f42-5d1c-48b0-8b81-d1ae56c7bfac tempest-AttachVolumeTestJSON-1416367693 None] Terminate volume connection completed successfully. Sep 01 08:20:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-671d6a4a-35ae-4f3f-b823-cdf8376d29a6 req-705d7f42-5d1c-48b0-8b81-d1ae56c7bfac tempest-AttachVolumeTestJSON-1416367693 None] Deleting attachment 6728bc32-4f40-4a91-8836-ab59c561835b. {{(pid=86893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 08:20:41 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-6cb4071b-459b-4330-b6b8-110bac1e3891 req-e625ceb6-0ae4-4707-a424-de82f2dd6ea9 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Terminate volume connection completed successfully. Sep 01 08:20:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-6cb4071b-459b-4330-b6b8-110bac1e3891 req-e625ceb6-0ae4-4707-a424-de82f2dd6ea9 tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Deleting attachment a9813a89-7d59-4806-9b70-612bf36ee9ab. {{(pid=86893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 08:20:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7d84b297-38c9-4d9e-8eae-8178fa7a9c5d tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Acquiring lock "cinder-779950c9-fbd7-4b19-946b-745c11ec48f3-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:20:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7d84b297-38c9-4d9e-8eae-8178fa7a9c5d tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Lock "cinder-779950c9-fbd7-4b19-946b-745c11ec48f3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:20:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7d84b297-38c9-4d9e-8eae-8178fa7a9c5d tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Acquiring lock "cinder-quobyte-779950c9-fbd7-4b19-946b-745c11ec48f3" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:20:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7d84b297-38c9-4d9e-8eae-8178fa7a9c5d tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Lock "cinder-quobyte-779950c9-fbd7-4b19-946b-745c11ec48f3" acquired by "delete_volume" :: waited 0.022s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:20:42 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bf1f38-0822-406a-90d8-ce01b7dcd085]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:20:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7d84b297-38c9-4d9e-8eae-8178fa7a9c5d tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-779950c9-fbd7-4b19-946b-745c11ec48f3 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:20:42 devstack sudo[95519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-779950c9-fbd7-4b19-946b-745c11ec48f3 Sep 01 08:20:42 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:20:43 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root Sep 01 08:20:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7d84b297-38c9-4d9e-8eae-8178fa7a9c5d tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-779950c9-fbd7-4b19-946b-745c11ec48f3" returned: 0 in 0.859s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:20:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7d84b297-38c9-4d9e-8eae-8178fa7a9c5d tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-779950c9-fbd7-4b19-946b-745c11ec48f3 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:20:43 devstack sudo[95568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-779950c9-fbd7-4b19-946b-745c11ec48f3 Sep 01 08:20:43 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:20:43 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root Sep 01 08:20:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7d84b297-38c9-4d9e-8eae-8178fa7a9c5d tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-779950c9-fbd7-4b19-946b-745c11ec48f3" returned: 0 in 0.708s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:20:43 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7d84b297-38c9-4d9e-8eae-8178fa7a9c5d tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Lock "cinder-quobyte-779950c9-fbd7-4b19-946b-745c11ec48f3" released by "delete_volume" :: held 1.637s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:20:43 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-7d84b297-38c9-4d9e-8eae-8178fa7a9c5d tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Created reservations ['46e92a12-2a03-4a59-8b7e-baa214d63d2b', 'df1437e2-5a7c-469f-a9ea-746491becdcd', '13df783c-4fcb-42ad-b6e2-7d3a4b4c54f9', '2c960885-9457-4fd0-b301-171c05e23cba'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:20:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7d84b297-38c9-4d9e-8eae-8178fa7a9c5d tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:20:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7d84b297-38c9-4d9e-8eae-8178fa7a9c5d tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:20:44 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7d84b297-38c9-4d9e-8eae-8178fa7a9c5d tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:20:44 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7d84b297-38c9-4d9e-8eae-8178fa7a9c5d tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:20:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7d84b297-38c9-4d9e-8eae-8178fa7a9c5d tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:20:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7d84b297-38c9-4d9e-8eae-8178fa7a9c5d tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:20:44 devstack sudo[95586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:20:44 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:20:44 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root Sep 01 08:20:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7d84b297-38c9-4d9e-8eae-8178fa7a9c5d tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.715s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:20:44 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-7d84b297-38c9-4d9e-8eae-8178fa7a9c5d tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:20:44 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-7d84b297-38c9-4d9e-8eae-8178fa7a9c5d tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Deleted volume successfully. Sep 01 08:20:45 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7d84b297-38c9-4d9e-8eae-8178fa7a9c5d tempest-TestServerVolumeAttachScenarioOldVersion-594404484 None] Lock "cinder-779950c9-fbd7-4b19-946b-745c11ec48f3-delete_volume" released by "delete_volume" :: held 2.924s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:20:54 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=17,cinder:UPDATE=20,cinder:INSERT=4,cinder:DELETE=3 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:20:54 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=25,cinder:UPDATE=18,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:21:04 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:21:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] Flow 'volume_create_manager' (0b8f8420-7435-4c43-b9c2-8412a21e133c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:21:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (906c81e0-c865-4521-9fa6-c191c1f5e297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:21:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (906c81e0-c865-4521-9fa6-c191c1f5e297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-736898718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b55b11b3-1e3a-4e97-806f-a5e7e8070a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5b8d36bbc9648b1a5de9b7029011628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:21:04Z,use_quota=True,user_id='4de653bb2a2f440a9380801d9b9a38fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:21:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff51a4f-feec-4e3a-801e-8a53541881b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:21:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff51a4f-feec-4e3a-801e-8a53541881b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:21:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f950afc-7457-4641-baf8-1daac46678d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:21:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f950afc-7457-4641-baf8-1daac46678d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b55b11b3-1e3a-4e97-806f-a5e7e8070a9b', 'volume_name': 'volume-b55b11b3-1e3a-4e97-806f-a5e7e8070a9b', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:21:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b3fba7-79b7-4c48-bd05-c674fd3fbc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:21:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b3fba7-79b7-4c48-bd05-c674fd3fbc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:21:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2b8e375-68ed-41d0-b3ba-ab9b4c5a3b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:21:04 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] Volume b55b11b3-1e3a-4e97-806f-a5e7e8070a9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b55b11b3-1e3a-4e97-806f-a5e7e8070a9b', 'volume_size': 1} Sep 01 08:21:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:21:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:21:04 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-736898718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b55b11b3-1e3a-4e97-806f-a5e7e8070a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5b8d36bbc9648b1a5de9b7029011628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:21:04Z,use_quota=True,user_id='4de653bb2a2f440a9380801d9b9a38fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:21:04 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] Creating volume b55b11b3-1e3a-4e97-806f-a5e7e8070a9b {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:21:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:21:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:21:04 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:21:04 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:21:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:21:04 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:21:04 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:21:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b55b11b3-1e3a-4e97-806f-a5e7e8070a9b 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:21:04 devstack sudo[95818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b55b11b3-1e3a-4e97-806f-a5e7e8070a9b 1073741824 Sep 01 08:21:04 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:21:05 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root Sep 01 08:21:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b55b11b3-1e3a-4e97-806f-a5e7e8070a9b 1073741824" returned: 0 in 0.598s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:21:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b55b11b3-1e3a-4e97-806f-a5e7e8070a9b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:21:05 devstack sudo[95826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b55b11b3-1e3a-4e97-806f-a5e7e8070a9b Sep 01 08:21:05 devstack sudo[95826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:21:05 devstack sudo[95826]: pam_unix(sudo:session): session closed for user root Sep 01 08:21:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b55b11b3-1e3a-4e97-806f-a5e7e8070a9b" returned: 0 in 0.255s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:21:05 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:21:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:21:05 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2b8e375-68ed-41d0-b3ba-ab9b4c5a3b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b55b11b3-1e3a-4e97-806f-a5e7e8070a9b', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:21:05 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b3bd5b4-a6b7-416f-8bef-287d359fd331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:21:05 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] Volume volume-b55b11b3-1e3a-4e97-806f-a5e7e8070a9b (b55b11b3-1e3a-4e97-806f-a5e7e8070a9b): created successfully Sep 01 08:21:05 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b3bd5b4-a6b7-416f-8bef-287d359fd331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:21:05 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] Flow 'volume_create_manager' (0b8f8420-7435-4c43-b9c2-8412a21e133c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:21:05 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-84adac91-4894-4581-a267-a1beb83e1d75 tempest-AttachVolumeNegativeTest-1390424861 None] Created volume successfully. Sep 01 08:21:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-d8a5a8e5-c35f-4cd2-af67-547f1ddfcf15 req-78dd353c-38c8-4c7f-8714-23c4d8c0ac65 tempest-AttachVolumeNegativeTest-1390424861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:21:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-d8a5a8e5-c35f-4cd2-af67-547f1ddfcf15 req-78dd353c-38c8-4c7f-8714-23c4d8c0ac65 tempest-AttachVolumeNegativeTest-1390424861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:21:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-d8a5a8e5-c35f-4cd2-af67-547f1ddfcf15 req-78dd353c-38c8-4c7f-8714-23c4d8c0ac65 tempest-AttachVolumeNegativeTest-1390424861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:21:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-d8a5a8e5-c35f-4cd2-af67-547f1ddfcf15 req-78dd353c-38c8-4c7f-8714-23c4d8c0ac65 tempest-AttachVolumeNegativeTest-1390424861 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049', 'name': 'volume-b55b11b3-1e3a-4e97-806f-a5e7e8070a9b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f28ebf6a-082c-4665-90f6-e2fe096e01d8', 'enforce_multipath': True} {{(pid=86893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 08:21:07 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-d8a5a8e5-c35f-4cd2-af67-547f1ddfcf15 req-78dd353c-38c8-4c7f-8714-23c4d8c0ac65 tempest-AttachVolumeNegativeTest-1390424861 None] attachment_update completed successfully. Sep 01 08:21:10 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-6b60a39b-c0f7-4dbb-9d8b-c7b906947ad2 req-a3a855e1-0b75-4413-bc8b-a48c74bd1224 tempest-AttachVolumeNegativeTest-1390424861 None] Terminate volume connection completed successfully. Sep 01 08:21:10 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-6b60a39b-c0f7-4dbb-9d8b-c7b906947ad2 req-a3a855e1-0b75-4413-bc8b-a48c74bd1224 tempest-AttachVolumeNegativeTest-1390424861 None] Deleting attachment f28ebf6a-082c-4665-90f6-e2fe096e01d8. {{(pid=86893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 08:21:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-67cd2aa1-bf56-4810-91ae-cc1beca0ad4f req-6fddb23b-1bd9-4b0f-8a6d-0731de566590 tempest-TestServerVolumeAttachmentScenario-119956435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:21:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-67cd2aa1-bf56-4810-91ae-cc1beca0ad4f req-6fddb23b-1bd9-4b0f-8a6d-0731de566590 tempest-TestServerVolumeAttachmentScenario-119956435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:21:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-67cd2aa1-bf56-4810-91ae-cc1beca0ad4f req-6fddb23b-1bd9-4b0f-8a6d-0731de566590 tempest-TestServerVolumeAttachmentScenario-119956435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:21:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-67cd2aa1-bf56-4810-91ae-cc1beca0ad4f req-6fddb23b-1bd9-4b0f-8a6d-0731de566590 tempest-TestServerVolumeAttachmentScenario-119956435 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049', 'name': 'volume-de9a9e63-5867-42cb-9d18-bfbfa05e4875', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '76e2e5ca-e3d5-47ce-b354-73fc0572c299', 'enforce_multipath': True} {{(pid=86893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 08:21:15 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-67cd2aa1-bf56-4810-91ae-cc1beca0ad4f req-6fddb23b-1bd9-4b0f-8a6d-0731de566590 tempest-TestServerVolumeAttachmentScenario-119956435 None] attachment_update completed successfully. Sep 01 08:21:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-2d5b24b8-e8f6-4020-b53c-6a84a0a982d9 req-8260d06f-b498-4abd-aba6-4eaad6d34285 tempest-TestServerVolumeAttachmentScenario-119956435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:21:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-2d5b24b8-e8f6-4020-b53c-6a84a0a982d9 req-8260d06f-b498-4abd-aba6-4eaad6d34285 tempest-TestServerVolumeAttachmentScenario-119956435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:21:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-2d5b24b8-e8f6-4020-b53c-6a84a0a982d9 req-8260d06f-b498-4abd-aba6-4eaad6d34285 tempest-TestServerVolumeAttachmentScenario-119956435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:21:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-2d5b24b8-e8f6-4020-b53c-6a84a0a982d9 req-8260d06f-b498-4abd-aba6-4eaad6d34285 tempest-TestServerVolumeAttachmentScenario-119956435 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049', 'name': 'volume-14019b2c-6dce-4733-80a0-4e0d0ee7e8fd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d3e074d-4e64-4316-9788-039589c1b513', 'enforce_multipath': True} {{(pid=86893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 08:21:21 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-2d5b24b8-e8f6-4020-b53c-6a84a0a982d9 req-8260d06f-b498-4abd-aba6-4eaad6d34285 tempest-TestServerVolumeAttachmentScenario-119956435 None] attachment_update completed successfully. Sep 01 08:21:24 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-20c3a3f6-d0bf-4028-84f4-0b643cb88ce7 req-4ed97202-4459-4ea9-8e9d-a8fd35e4fe50 tempest-TestServerVolumeAttachmentScenario-119956435 None] Terminate volume connection completed successfully. Sep 01 08:21:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-20c3a3f6-d0bf-4028-84f4-0b643cb88ce7 req-4ed97202-4459-4ea9-8e9d-a8fd35e4fe50 tempest-TestServerVolumeAttachmentScenario-119956435 None] Deleting attachment 6d3e074d-4e64-4316-9788-039589c1b513. {{(pid=86893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 08:21:26 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-fa9bb410-799d-48a9-81b4-d3ec13b9080d req-cc1f2799-01f5-418c-a6da-2257c0b1c114 tempest-TestServerVolumeAttachmentScenario-119956435 None] Terminate volume connection completed successfully. Sep 01 08:21:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-fa9bb410-799d-48a9-81b4-d3ec13b9080d req-cc1f2799-01f5-418c-a6da-2257c0b1c114 tempest-TestServerVolumeAttachmentScenario-119956435 None] Deleting attachment 76e2e5ca-e3d5-47ce-b354-73fc0572c299. {{(pid=86893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 08:21:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager._thread_info {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:21:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread count: 28 {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 08:21:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread info: [<_MainThread(MainThread, started 138934582050944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 08:21:36 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=25,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:21:36 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:UPDATE=8,cinder:SELECT=24,cinder:INSERT=1 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:21:36 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:21:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] Flow 'volume_create_manager' (4a0337db-8dd8-42c3-a61c-044b49833594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:21:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99560f9f-9bc9-4795-9fd9-d9079ceb6860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:21:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99560f9f-9bc9-4795-9fd9-d9079ceb6860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1258127359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65a66916-1746-4c64-856e-777ea29489db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7b4b080e0b44134958d87a5a70c431c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:21:37Z,use_quota=True,user_id='2c4bd33972354c8abf4543d3250a2f34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:21:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f7bf103-5218-45bf-9455-e2f7fc68b716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:21:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f7bf103-5218-45bf-9455-e2f7fc68b716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:21:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fefa520-0f3c-4f0a-ad6b-031f61bffc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:21:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fefa520-0f3c-4f0a-ad6b-031f61bffc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65a66916-1746-4c64-856e-777ea29489db', 'volume_name': 'volume-65a66916-1746-4c64-856e-777ea29489db', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:21:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c94e30b7-9a3f-49b3-a03c-9180f50ca131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:21:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c94e30b7-9a3f-49b3-a03c-9180f50ca131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:21:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e35c648-9b6c-40a2-9fca-68599876b879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:21:37 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] Volume 65a66916-1746-4c64-856e-777ea29489db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65a66916-1746-4c64-856e-777ea29489db', 'volume_size': 1} Sep 01 08:21:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:21:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:21:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1258127359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65a66916-1746-4c64-856e-777ea29489db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7b4b080e0b44134958d87a5a70c431c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:21:37Z,use_quota=True,user_id='2c4bd33972354c8abf4543d3250a2f34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:21:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] Creating volume 65a66916-1746-4c64-856e-777ea29489db {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:21:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:21:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:21:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:21:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:21:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:21:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:21:37 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:21:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-65a66916-1746-4c64-856e-777ea29489db 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:21:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-693fd150-023d-4bbd-b9f5-1cffc6618ad2 tempest-TestServerVolumeAttachmentScenario-119956435 None] Acquiring lock "cinder-14019b2c-6dce-4733-80a0-4e0d0ee7e8fd-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:21:37 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-65a66916-1746-4c64-856e-777ea29489db 1073741824 Sep 01 08:21:37 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:21:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-693fd150-023d-4bbd-b9f5-1cffc6618ad2 tempest-TestServerVolumeAttachmentScenario-119956435 None] Lock "cinder-14019b2c-6dce-4733-80a0-4e0d0ee7e8fd-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:21:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-693fd150-023d-4bbd-b9f5-1cffc6618ad2 tempest-TestServerVolumeAttachmentScenario-119956435 None] Acquiring lock "cinder-quobyte-14019b2c-6dce-4733-80a0-4e0d0ee7e8fd" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:21:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-693fd150-023d-4bbd-b9f5-1cffc6618ad2 tempest-TestServerVolumeAttachmentScenario-119956435 None] Lock "cinder-quobyte-14019b2c-6dce-4733-80a0-4e0d0ee7e8fd" acquired by "delete_volume" :: waited 0.037s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:21:37 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cb2694-e022-4021-a4ee-727d27e77eef]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:21:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-693fd150-023d-4bbd-b9f5-1cffc6618ad2 tempest-TestServerVolumeAttachmentScenario-119956435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-14019b2c-6dce-4733-80a0-4e0d0ee7e8fd {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:21:37 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-14019b2c-6dce-4733-80a0-4e0d0ee7e8fd Sep 01 08:21:37 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:21:38 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Sep 01 08:21:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-65a66916-1746-4c64-856e-777ea29489db 1073741824" returned: 0 in 1.214s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:21:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-65a66916-1746-4c64-856e-777ea29489db {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:21:38 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-65a66916-1746-4c64-856e-777ea29489db Sep 01 08:21:38 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:21:38 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Sep 01 08:21:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-693fd150-023d-4bbd-b9f5-1cffc6618ad2 tempest-TestServerVolumeAttachmentScenario-119956435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-14019b2c-6dce-4733-80a0-4e0d0ee7e8fd" returned: 0 in 1.012s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:21:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-693fd150-023d-4bbd-b9f5-1cffc6618ad2 tempest-TestServerVolumeAttachmentScenario-119956435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-14019b2c-6dce-4733-80a0-4e0d0ee7e8fd {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:21:38 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-14019b2c-6dce-4733-80a0-4e0d0ee7e8fd Sep 01 08:21:38 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:21:39 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Sep 01 08:21:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-65a66916-1746-4c64-856e-777ea29489db" returned: 0 in 0.762s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:21:39 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Sep 01 08:21:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] <== create_volume: return (2044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:21:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.055s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:21:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-693fd150-023d-4bbd-b9f5-1cffc6618ad2 tempest-TestServerVolumeAttachmentScenario-119956435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-14019b2c-6dce-4733-80a0-4e0d0ee7e8fd" returned: 0 in 0.603s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:21:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-693fd150-023d-4bbd-b9f5-1cffc6618ad2 tempest-TestServerVolumeAttachmentScenario-119956435 None] Lock "cinder-quobyte-14019b2c-6dce-4733-80a0-4e0d0ee7e8fd" released by "delete_volume" :: held 1.785s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:21:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e35c648-9b6c-40a2-9fca-68599876b879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65a66916-1746-4c64-856e-777ea29489db', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:21:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (485e69f6-55f8-4ca9-b531-e56495bd96f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:21:39 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] Volume volume-65a66916-1746-4c64-856e-777ea29489db (65a66916-1746-4c64-856e-777ea29489db): created successfully Sep 01 08:21:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (485e69f6-55f8-4ca9-b531-e56495bd96f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:21:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] Flow 'volume_create_manager' (4a0337db-8dd8-42c3-a61c-044b49833594) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:21:39 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-96372c84-b56c-4bbc-858a-d194f9119292 tempest-TestImageHashVerification-416428677 None] Created volume successfully. Sep 01 08:21:39 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-693fd150-023d-4bbd-b9f5-1cffc6618ad2 tempest-TestServerVolumeAttachmentScenario-119956435 None] Created reservations ['0a34f5e2-7dec-4a82-a408-a5d3e7fd0926', 'c6d90f1e-9dd9-447d-8159-a6e69be7ca24', 'e2d4d2ac-3a2d-48eb-8c65-8f914a874cb0', '8f82d6eb-b56f-44ee-b3c7-476f4c4e6a46'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:21:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-693fd150-023d-4bbd-b9f5-1cffc6618ad2 tempest-TestServerVolumeAttachmentScenario-119956435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:21:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-693fd150-023d-4bbd-b9f5-1cffc6618ad2 tempest-TestServerVolumeAttachmentScenario-119956435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:21:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-693fd150-023d-4bbd-b9f5-1cffc6618ad2 tempest-TestServerVolumeAttachmentScenario-119956435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:21:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-693fd150-023d-4bbd-b9f5-1cffc6618ad2 tempest-TestServerVolumeAttachmentScenario-119956435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:21:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-693fd150-023d-4bbd-b9f5-1cffc6618ad2 tempest-TestServerVolumeAttachmentScenario-119956435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:21:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-693fd150-023d-4bbd-b9f5-1cffc6618ad2 tempest-TestServerVolumeAttachmentScenario-119956435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:21:39 devstack sudo[96963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:21:39 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:21:39 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root Sep 01 08:21:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-693fd150-023d-4bbd-b9f5-1cffc6618ad2 tempest-TestServerVolumeAttachmentScenario-119956435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.413s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:21:39 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-693fd150-023d-4bbd-b9f5-1cffc6618ad2 tempest-TestServerVolumeAttachmentScenario-119956435 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:21:40 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-693fd150-023d-4bbd-b9f5-1cffc6618ad2 tempest-TestServerVolumeAttachmentScenario-119956435 None] Deleted volume successfully. Sep 01 08:21:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-693fd150-023d-4bbd-b9f5-1cffc6618ad2 tempest-TestServerVolumeAttachmentScenario-119956435 None] Lock "cinder-14019b2c-6dce-4733-80a0-4e0d0ee7e8fd-delete_volume" released by "delete_volume" :: held 2.923s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:21:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9b7d2425-1a26-41c7-a1a1-b86357fa115c tempest-TestServerVolumeAttachmentScenario-119956435 None] Acquiring lock "cinder-de9a9e63-5867-42cb-9d18-bfbfa05e4875-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:21:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9b7d2425-1a26-41c7-a1a1-b86357fa115c tempest-TestServerVolumeAttachmentScenario-119956435 None] Lock "cinder-de9a9e63-5867-42cb-9d18-bfbfa05e4875-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:21:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9b7d2425-1a26-41c7-a1a1-b86357fa115c tempest-TestServerVolumeAttachmentScenario-119956435 None] Acquiring lock "cinder-quobyte-de9a9e63-5867-42cb-9d18-bfbfa05e4875" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:21:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9b7d2425-1a26-41c7-a1a1-b86357fa115c tempest-TestServerVolumeAttachmentScenario-119956435 None] Lock "cinder-quobyte-de9a9e63-5867-42cb-9d18-bfbfa05e4875" acquired by "delete_volume" :: waited 0.040s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:21:40 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88a938f-c1f6-4d06-9adc-048c8a333d6c]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:21:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9b7d2425-1a26-41c7-a1a1-b86357fa115c tempest-TestServerVolumeAttachmentScenario-119956435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-de9a9e63-5867-42cb-9d18-bfbfa05e4875 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:21:41 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-de9a9e63-5867-42cb-9d18-bfbfa05e4875 Sep 01 08:21:41 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:21:41 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Sep 01 08:21:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9b7d2425-1a26-41c7-a1a1-b86357fa115c tempest-TestServerVolumeAttachmentScenario-119956435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-de9a9e63-5867-42cb-9d18-bfbfa05e4875" returned: 0 in 0.854s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:21:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9b7d2425-1a26-41c7-a1a1-b86357fa115c tempest-TestServerVolumeAttachmentScenario-119956435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-de9a9e63-5867-42cb-9d18-bfbfa05e4875 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:21:41 devstack sudo[96972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-de9a9e63-5867-42cb-9d18-bfbfa05e4875 Sep 01 08:21:41 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:21:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2494a3ee-50c0-4d72-a652-74b95c7e99fe tempest-TestImageHashVerification-416428677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:21:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2494a3ee-50c0-4d72-a652-74b95c7e99fe tempest-TestImageHashVerification-416428677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:21:42 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5bd516-4f25-4eca-ba50-84f67a0ea7e7]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:21:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2494a3ee-50c0-4d72-a652-74b95c7e99fe tempest-TestImageHashVerification-416428677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-65a66916-1746-4c64-856e-777ea29489db {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:21:42 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root Sep 01 08:21:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9b7d2425-1a26-41c7-a1a1-b86357fa115c tempest-TestServerVolumeAttachmentScenario-119956435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-de9a9e63-5867-42cb-9d18-bfbfa05e4875" returned: 0 in 0.450s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:21:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9b7d2425-1a26-41c7-a1a1-b86357fa115c tempest-TestServerVolumeAttachmentScenario-119956435 None] Lock "cinder-quobyte-de9a9e63-5867-42cb-9d18-bfbfa05e4875" released by "delete_volume" :: held 1.393s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:21:42 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-9b7d2425-1a26-41c7-a1a1-b86357fa115c tempest-TestServerVolumeAttachmentScenario-119956435 None] Created reservations ['d5fa7e1e-c432-4e33-a007-8eda8a2293f9', '8ed339d8-dfa8-4725-b766-423669faf286', '8ac7cc1e-21b6-4264-aef0-2657d1b511e0', '2442b155-7ce6-4e57-ac2b-eebe82dc8487'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:21:42 devstack sudo[96974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-65a66916-1746-4c64-856e-777ea29489db Sep 01 08:21:42 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:21:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9b7d2425-1a26-41c7-a1a1-b86357fa115c tempest-TestServerVolumeAttachmentScenario-119956435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:21:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9b7d2425-1a26-41c7-a1a1-b86357fa115c tempest-TestServerVolumeAttachmentScenario-119956435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:21:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-9b7d2425-1a26-41c7-a1a1-b86357fa115c tempest-TestServerVolumeAttachmentScenario-119956435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:21:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-9b7d2425-1a26-41c7-a1a1-b86357fa115c tempest-TestServerVolumeAttachmentScenario-119956435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:21:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9b7d2425-1a26-41c7-a1a1-b86357fa115c tempest-TestServerVolumeAttachmentScenario-119956435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:21:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9b7d2425-1a26-41c7-a1a1-b86357fa115c tempest-TestServerVolumeAttachmentScenario-119956435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:21:42 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:21:42 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:21:42 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root Sep 01 08:21:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2494a3ee-50c0-4d72-a652-74b95c7e99fe tempest-TestImageHashVerification-416428677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-65a66916-1746-4c64-856e-777ea29489db" returned: 0 in 0.792s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:21:42 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dd235f-2e44-4086-b253-29b0d80404b9]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:21:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2494a3ee-50c0-4d72-a652-74b95c7e99fe tempest-TestImageHashVerification-416428677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-65a66916-1746-4c64-856e-777ea29489db {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:21:43 devstack sudo[96983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-65a66916-1746-4c64-856e-777ea29489db Sep 01 08:21:43 devstack sudo[96983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:21:43 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Sep 01 08:21:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9b7d2425-1a26-41c7-a1a1-b86357fa115c tempest-TestServerVolumeAttachmentScenario-119956435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.657s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:21:43 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-9b7d2425-1a26-41c7-a1a1-b86357fa115c tempest-TestServerVolumeAttachmentScenario-119956435 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:21:43 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-9b7d2425-1a26-41c7-a1a1-b86357fa115c tempest-TestServerVolumeAttachmentScenario-119956435 None] Deleted volume successfully. Sep 01 08:21:43 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9b7d2425-1a26-41c7-a1a1-b86357fa115c tempest-TestServerVolumeAttachmentScenario-119956435 None] Lock "cinder-de9a9e63-5867-42cb-9d18-bfbfa05e4875-delete_volume" released by "delete_volume" :: held 2.563s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:21:43 devstack sudo[96983]: pam_unix(sudo:session): session closed for user root Sep 01 08:21:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2494a3ee-50c0-4d72-a652-74b95c7e99fe tempest-TestImageHashVerification-416428677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-65a66916-1746-4c64-856e-777ea29489db" returned: 0 in 0.580s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:21:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2494a3ee-50c0-4d72-a652-74b95c7e99fe tempest-TestImageHashVerification-416428677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-65a66916-1746-4c64-856e-777ea29489db /opt/stack/data/cinder/conversion/65a66916-1746-4c64-856e-777ea29489db.temp_image.b37185db-07cd-4b0f-a502-e7fc96a3806d1er88xx9.img {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:21:43 devstack sudo[96990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-65a66916-1746-4c64-856e-777ea29489db /opt/stack/data/cinder/conversion/65a66916-1746-4c64-856e-777ea29489db.temp_image.b37185db-07cd-4b0f-a502-e7fc96a3806d1er88xx9.img Sep 01 08:21:43 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:21:50 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root Sep 01 08:21:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2494a3ee-50c0-4d72-a652-74b95c7e99fe tempest-TestImageHashVerification-416428677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-65a66916-1746-4c64-856e-777ea29489db /opt/stack/data/cinder/conversion/65a66916-1746-4c64-856e-777ea29489db.temp_image.b37185db-07cd-4b0f-a502-e7fc96a3806d1er88xx9.img" returned: 0 in 7.564s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:21:50 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d4cbd4-ecc0-4edb-b9f5-35a96dcabef7]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:21:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2494a3ee-50c0-4d72-a652-74b95c7e99fe tempest-TestImageHashVerification-416428677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-65a66916-1746-4c64-856e-777ea29489db {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:21:51 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-65a66916-1746-4c64-856e-777ea29489db Sep 01 08:21:51 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:21:51 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Sep 01 08:21:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2494a3ee-50c0-4d72-a652-74b95c7e99fe tempest-TestImageHashVerification-416428677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-65a66916-1746-4c64-856e-777ea29489db" returned: 0 in 0.910s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:21:51 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-2494a3ee-50c0-4d72-a652-74b95c7e99fe tempest-TestImageHashVerification-416428677 None] Image conversion details: src /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-65a66916-1746-4c64-856e-777ea29489db, size 1024.00 MB, duration 7.57 sec, destination /opt/stack/data/cinder/conversion/65a66916-1746-4c64-856e-777ea29489db.temp_image.b37185db-07cd-4b0f-a502-e7fc96a3806d1er88xx9.img {{(pid=86893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 08:21:51 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-2494a3ee-50c0-4d72-a652-74b95c7e99fe tempest-TestImageHashVerification-416428677 None] Converted 1024.00 MB image at 135.36 MB/s Sep 01 08:21:51 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-2494a3ee-50c0-4d72-a652-74b95c7e99fe tempest-TestImageHashVerification-416428677 None] b37185db-07cd-4b0f-a502-e7fc96a3806d was raw, no need to convert to raw {{(pid=86893) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 01 08:22:01 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=11,cinder:UPDATE=19,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:22:01 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=16,cinder:UPDATE=19,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:22:03 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:22:03 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Flow 'volume_create_manager' (b88f3733-0978-479c-8454-3faf0b8e3178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:03 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9cd722-20bf-4449-a240-d56b7dde3e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:03 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9cd722-20bf-4449-a240-d56b7dde3e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1660287427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf88953-7ae1-48ae-997c-3077c60e2252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf6888f9d3943e88cf55332c940ecbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:03Z,use_quota=True,user_id='a7da3e78362f4823933e634bddbc59b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:03 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c00b59-79cd-4bd7-a054-0198496fd83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:03 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c00b59-79cd-4bd7-a054-0198496fd83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:03 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc3a4992-f71c-4d7d-b61d-bc993f21290f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:03 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc3a4992-f71c-4d7d-b61d-bc993f21290f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcf88953-7ae1-48ae-997c-3077c60e2252', 'volume_name': 'volume-fcf88953-7ae1-48ae-997c-3077c60e2252', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:03 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b588a3c-611c-4aa6-9025-d0a867251841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:03 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b588a3c-611c-4aa6-9025-d0a867251841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:03 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b2d1a0-8094-4aeb-8fc6-36b293b15c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:03 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Volume fcf88953-7ae1-48ae-997c-3077c60e2252: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcf88953-7ae1-48ae-997c-3077c60e2252', 'volume_size': 1} Sep 01 08:22:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:04 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:22:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] Flow 'volume_create_manager' (db950340-6085-44a4-90ec-1708e663b113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83e1821-180a-4ebc-83dc-478ad0d6c755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83e1821-180a-4ebc-83dc-478ad0d6c755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-937394293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70dc04de-dba3-4381-9fd8-441a70d18eee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5b8d36bbc9648b1a5de9b7029011628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:04Z,use_quota=True,user_id='4de653bb2a2f440a9380801d9b9a38fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdeae336-ef08-484a-8a94-0b419d9de413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdeae336-ef08-484a-8a94-0b419d9de413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5fe323-a659-4f55-99d1-218d00c014bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5fe323-a659-4f55-99d1-218d00c014bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70dc04de-dba3-4381-9fd8-441a70d18eee', 'volume_name': 'volume-70dc04de-dba3-4381-9fd8-441a70d18eee', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a96e94f6-775d-4ef5-950f-b2106207a09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a96e94f6-775d-4ef5-950f-b2106207a09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6846e416-becd-4cb6-aa87-6cb1f5b61338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:04 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] Volume 70dc04de-dba3-4381-9fd8-441a70d18eee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70dc04de-dba3-4381-9fd8-441a70d18eee', 'volume_size': 1} Sep 01 08:22:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:04 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:22:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] Flow 'volume_create_manager' (12333dea-c594-4719-862e-037d8c59c8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be0035d4-8c1e-43e3-9ba5-37eec9ddde97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be0035d4-8c1e-43e3-9ba5-37eec9ddde97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1617094120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3e5ff8-1442-49ce-a676-bcff22403e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b1cc159fd140dab302988a1741d63e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:05Z,use_quota=True,user_id='5c502c57d18c44c7a031d8149a6c4f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b68887-0d35-4565-877d-cbc913411c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b68887-0d35-4565-877d-cbc913411c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b239a6b3-f0c4-4e05-add3-a99060dbd1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b239a6b3-f0c4-4e05-add3-a99060dbd1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad3e5ff8-1442-49ce-a676-bcff22403e65', 'volume_name': 'volume-ad3e5ff8-1442-49ce-a676-bcff22403e65', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94c0a31-55c6-42d5-b5b6-4d511f083bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94c0a31-55c6-42d5-b5b6-4d511f083bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cf38c7b-2fa2-4ea7-94ae-6f476dc660b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:04 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] Volume ad3e5ff8-1442-49ce-a676-bcff22403e65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad3e5ff8-1442-49ce-a676-bcff22403e65', 'volume_size': 1} Sep 01 08:22:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2494a3ee-50c0-4d72-a652-74b95c7e99fe tempest-TestImageHashVerification-416428677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.478s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:13 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2494a3ee-50c0-4d72-a652-74b95c7e99fe tempest-TestImageHashVerification-416428677 None] Uploaded volume to glance image-id: b37185db-07cd-4b0f-a502-e7fc96a3806d. {{(pid=86893) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 08:22:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.062s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:13 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1660287427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf88953-7ae1-48ae-997c-3077c60e2252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf6888f9d3943e88cf55332c940ecbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:03Z,use_quota=True,user_id='a7da3e78362f4823933e634bddbc59b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:22:13 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Creating volume fcf88953-7ae1-48ae-997c-3077c60e2252 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:22:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:13 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:13 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:13 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:22:13 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:22:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:13 devstack sudo[97105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252 1073741824 Sep 01 08:22:13 devstack sudo[97105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:13 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-2494a3ee-50c0-4d72-a652-74b95c7e99fe tempest-TestImageHashVerification-416428677 None] Copy volume to image completed successfully. Sep 01 08:22:13 devstack sudo[97105]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252 1073741824" returned: 0 in 0.446s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:13 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252 Sep 01 08:22:13 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:14 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252" returned: 0 in 0.250s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:14 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:22:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.887s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:14 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-937394293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70dc04de-dba3-4381-9fd8-441a70d18eee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5b8d36bbc9648b1a5de9b7029011628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:04Z,use_quota=True,user_id='4de653bb2a2f440a9380801d9b9a38fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:22:14 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] Creating volume 70dc04de-dba3-4381-9fd8-441a70d18eee {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:22:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:14 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:14 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:14 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:22:14 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:22:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-70dc04de-dba3-4381-9fd8-441a70d18eee 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b2d1a0-8094-4aeb-8fc6-36b293b15c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcf88953-7ae1-48ae-997c-3077c60e2252', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:14 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-70dc04de-dba3-4381-9fd8-441a70d18eee 1073741824 Sep 01 08:22:14 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c2d01d3-8059-4c57-aeb4-2ffa87ccf41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:14 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Volume volume-fcf88953-7ae1-48ae-997c-3077c60e2252 (fcf88953-7ae1-48ae-997c-3077c60e2252): created successfully Sep 01 08:22:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c2d01d3-8059-4c57-aeb4-2ffa87ccf41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Flow 'volume_create_manager' (b88f3733-0978-479c-8454-3faf0b8e3178) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:14 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-95b35380-3c45-42f8-919d-94d0296963b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Created volume successfully. Sep 01 08:22:14 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b5b417a8-9c93-4ad1-b63c-5f941592e700 tempest-TestImageHashVerification-416428677 None] Acquiring lock "cinder-65a66916-1746-4c64-856e-777ea29489db-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:14 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b5b417a8-9c93-4ad1-b63c-5f941592e700 tempest-TestImageHashVerification-416428677 None] Lock "cinder-65a66916-1746-4c64-856e-777ea29489db-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:14 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b5b417a8-9c93-4ad1-b63c-5f941592e700 tempest-TestImageHashVerification-416428677 None] Acquiring lock "cinder-quobyte-65a66916-1746-4c64-856e-777ea29489db" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:14 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b5b417a8-9c93-4ad1-b63c-5f941592e700 tempest-TestImageHashVerification-416428677 None] Lock "cinder-quobyte-65a66916-1746-4c64-856e-777ea29489db" acquired by "delete_volume" :: waited 0.015s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:14 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[6667c47c-0060-43d4-9a21-51898e45102c]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:22:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b5b417a8-9c93-4ad1-b63c-5f941592e700 tempest-TestImageHashVerification-416428677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-65a66916-1746-4c64-856e-777ea29489db {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:14 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-65a66916-1746-4c64-856e-777ea29489db Sep 01 08:22:14 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:14 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-70dc04de-dba3-4381-9fd8-441a70d18eee 1073741824" returned: 0 in 0.487s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-70dc04de-dba3-4381-9fd8-441a70d18eee {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:14 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-70dc04de-dba3-4381-9fd8-441a70d18eee Sep 01 08:22:14 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:14 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b5b417a8-9c93-4ad1-b63c-5f941592e700 tempest-TestImageHashVerification-416428677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-65a66916-1746-4c64-856e-777ea29489db" returned: 0 in 0.410s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b5b417a8-9c93-4ad1-b63c-5f941592e700 tempest-TestImageHashVerification-416428677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-65a66916-1746-4c64-856e-777ea29489db {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:14 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-65a66916-1746-4c64-856e-777ea29489db Sep 01 08:22:14 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:15 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-70dc04de-dba3-4381-9fd8-441a70d18eee" returned: 0 in 0.293s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.016s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1617094120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3e5ff8-1442-49ce-a676-bcff22403e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b1cc159fd140dab302988a1741d63e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:05Z,use_quota=True,user_id='5c502c57d18c44c7a031d8149a6c4f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] Creating volume ad3e5ff8-1442-49ce-a676-bcff22403e65 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:22:15 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ad3e5ff8-1442-49ce-a676-bcff22403e65 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6846e416-becd-4cb6-aa87-6cb1f5b61338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70dc04de-dba3-4381-9fd8-441a70d18eee', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8838e4a-0607-413f-b843-935ccdf730b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:15 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ad3e5ff8-1442-49ce-a676-bcff22403e65 1073741824 Sep 01 08:22:15 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:15 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] Volume volume-70dc04de-dba3-4381-9fd8-441a70d18eee (70dc04de-dba3-4381-9fd8-441a70d18eee): created successfully Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8838e4a-0607-413f-b843-935ccdf730b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] Flow 'volume_create_manager' (db950340-6085-44a4-90ec-1708e663b113) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:15 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-2dcac690-ec98-4432-9f92-a105c23b34cf tempest-AttachVolumeNegativeTest-1390424861 None] Created volume successfully. Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9884621e-8e76-4d7e-a24c-1daa1031d3c8 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:15 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b5b417a8-9c93-4ad1-b63c-5f941592e700 tempest-TestImageHashVerification-416428677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-65a66916-1746-4c64-856e-777ea29489db" returned: 0 in 0.288s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b5b417a8-9c93-4ad1-b63c-5f941592e700 tempest-TestImageHashVerification-416428677 None] Lock "cinder-quobyte-65a66916-1746-4c64-856e-777ea29489db" released by "delete_volume" :: held 0.742s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-b5b417a8-9c93-4ad1-b63c-5f941592e700 tempest-TestImageHashVerification-416428677 None] Created reservations ['42bb5695-7122-4045-b591-98db10d44d47', '65bc2730-a021-4a9a-99f4-5128515e7eb4', '3eaf9817-4153-4259-8a9a-ce12dc690410', '732240b6-4a25-4fb5-9d4b-c11d63c028b6'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b5b417a8-9c93-4ad1-b63c-5f941592e700 tempest-TestImageHashVerification-416428677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b5b417a8-9c93-4ad1-b63c-5f941592e700 tempest-TestImageHashVerification-416428677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b5b417a8-9c93-4ad1-b63c-5f941592e700 tempest-TestImageHashVerification-416428677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b5b417a8-9c93-4ad1-b63c-5f941592e700 tempest-TestImageHashVerification-416428677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b5b417a8-9c93-4ad1-b63c-5f941592e700 tempest-TestImageHashVerification-416428677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b5b417a8-9c93-4ad1-b63c-5f941592e700 tempest-TestImageHashVerification-416428677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:15 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:22:15 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:15 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ad3e5ff8-1442-49ce-a676-bcff22403e65 1073741824" returned: 0 in 0.478s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ad3e5ff8-1442-49ce-a676-bcff22403e65 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:15 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ad3e5ff8-1442-49ce-a676-bcff22403e65 Sep 01 08:22:15 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:15 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b5b417a8-9c93-4ad1-b63c-5f941592e700 tempest-TestImageHashVerification-416428677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.289s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-b5b417a8-9c93-4ad1-b63c-5f941592e700 tempest-TestImageHashVerification-416428677 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:22:15 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-b5b417a8-9c93-4ad1-b63c-5f941592e700 tempest-TestImageHashVerification-416428677 None] Deleted volume successfully. Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b5b417a8-9c93-4ad1-b63c-5f941592e700 tempest-TestImageHashVerification-416428677 None] Lock "cinder-65a66916-1746-4c64-856e-777ea29489db-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:15 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ad3e5ff8-1442-49ce-a676-bcff22403e65" returned: 0 in 0.266s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9884621e-8e76-4d7e-a24c-1daa1031d3c8 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.642s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cf38c7b-2fa2-4ea7-94ae-6f476dc660b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad3e5ff8-1442-49ce-a676-bcff22403e65', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf6219e-2cf5-4887-b348-38cffcd55f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-9884621e-8e76-4d7e-a24c-1daa1031d3c8 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Creating offline snapshot d18df74a-79f5-4009-8fa8-4970534fb6a2 of volume fcf88953-7ae1-48ae-997c-3077c60e2252 {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:22:15 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] Volume volume-ad3e5ff8-1442-49ce-a676-bcff22403e65 (ad3e5ff8-1442-49ce-a676-bcff22403e65): created successfully Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf6219e-2cf5-4887-b348-38cffcd55f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] Flow 'volume_create_manager' (12333dea-c594-4719-862e-037d8c59c8f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5358eb-cb4e-4551-9a78-73f8764e801a]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:22:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9884621e-8e76-4d7e-a24c-1daa1031d3c8 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:15 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-8020a3a6-742f-4ed6-9d8f-f74b9ee491f3 tempest-AttachVolumeTestJSON-1416367693 None] Created volume successfully. Sep 01 08:22:16 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252 Sep 01 08:22:16 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:16 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9884621e-8e76-4d7e-a24c-1daa1031d3c8 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252" returned: 0 in 0.444s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9884621e-8e76-4d7e-a24c-1daa1031d3c8 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252.d18df74a-79f5-4009-8fa8-4970534fb6a2 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:16 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252.d18df74a-79f5-4009-8fa8-4970534fb6a2 1G Sep 01 08:22:16 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-eab5bf68-0194-4d6f-9d8b-d47c172f2d00 req-e506fc11-7dc6-4ed2-8942-fc693fdad30d tempest-AttachVolumeNegativeTest-1390424861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:16 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9884621e-8e76-4d7e-a24c-1daa1031d3c8 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252.d18df74a-79f5-4009-8fa8-4970534fb6a2 1G" returned: 0 in 0.512s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9884621e-8e76-4d7e-a24c-1daa1031d3c8 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcf88953-7ae1-48ae-997c-3077c60e2252 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252.d18df74a-79f5-4009-8fa8-4970534fb6a2 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:16 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcf88953-7ae1-48ae-997c-3077c60e2252 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252.d18df74a-79f5-4009-8fa8-4970534fb6a2 Sep 01 08:22:16 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:17 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9884621e-8e76-4d7e-a24c-1daa1031d3c8 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcf88953-7ae1-48ae-997c-3077c60e2252 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252.d18df74a-79f5-4009-8fa8-4970534fb6a2" returned: 0 in 0.320s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:17 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-9884621e-8e76-4d7e-a24c-1daa1031d3c8 tempest-CreateVolumesFromSnapshotTest-1966592782 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252.d18df74a-79f5-4009-8fa8-4970534fb6a2 is being set with open permissions: ugo+rw Sep 01 08:22:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9884621e-8e76-4d7e-a24c-1daa1031d3c8 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252.d18df74a-79f5-4009-8fa8-4970534fb6a2 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:17 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252.d18df74a-79f5-4009-8fa8-4970534fb6a2 Sep 01 08:22:17 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:17 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9884621e-8e76-4d7e-a24c-1daa1031d3c8 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252.d18df74a-79f5-4009-8fa8-4970534fb6a2" returned: 0 in 0.350s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9884621e-8e76-4d7e-a24c-1daa1031d3c8 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:17 devstack sudo[97186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252.info Sep 01 08:22:17 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-23847f64-81da-4784-b4a4-4f7f5cb0a222 req-4202b020-5422-478d-9c72-02d8fe97a372 tempest-AttachVolumeTestJSON-1416367693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:17 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9884621e-8e76-4d7e-a24c-1daa1031d3c8 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252.info" returned: 0 in 0.272s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:17 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-9884621e-8e76-4d7e-a24c-1daa1031d3c8 tempest-CreateVolumesFromSnapshotTest-1966592782 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252.info is being set with open permissions: ugo+rw Sep 01 08:22:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9884621e-8e76-4d7e-a24c-1daa1031d3c8 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:17 devstack sudo[97189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252.info Sep 01 08:22:17 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:18 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9884621e-8e76-4d7e-a24c-1daa1031d3c8 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252.info" returned: 0 in 0.256s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9884621e-8e76-4d7e-a24c-1daa1031d3c8 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.289s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-eab5bf68-0194-4d6f-9d8b-d47c172f2d00 req-e506fc11-7dc6-4ed2-8942-fc693fdad30d tempest-AttachVolumeNegativeTest-1390424861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.446s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-eab5bf68-0194-4d6f-9d8b-d47c172f2d00 req-e506fc11-7dc6-4ed2-8942-fc693fdad30d tempest-AttachVolumeNegativeTest-1390424861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-23847f64-81da-4784-b4a4-4f7f5cb0a222 req-4202b020-5422-478d-9c72-02d8fe97a372 tempest-AttachVolumeTestJSON-1416367693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.481s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:18 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-9884621e-8e76-4d7e-a24c-1daa1031d3c8 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Create snapshot completed successfully Sep 01 08:22:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-23847f64-81da-4784-b4a4-4f7f5cb0a222 req-4202b020-5422-478d-9c72-02d8fe97a372 tempest-AttachVolumeTestJSON-1416367693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:18 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-eab5bf68-0194-4d6f-9d8b-d47c172f2d00 req-e506fc11-7dc6-4ed2-8942-fc693fdad30d tempest-AttachVolumeNegativeTest-1390424861 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049', 'name': 'volume-70dc04de-dba3-4381-9fd8-441a70d18eee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b87176e1-ac5f-45b1-8a42-332e3d99d994', 'enforce_multipath': True} {{(pid=86893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 08:22:18 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-23847f64-81da-4784-b4a4-4f7f5cb0a222 req-4202b020-5422-478d-9c72-02d8fe97a372 tempest-AttachVolumeTestJSON-1416367693 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049', 'name': 'volume-ad3e5ff8-1442-49ce-a676-bcff22403e65', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b937dd59-962b-40ec-b353-dee185beafc0', 'enforce_multipath': True} {{(pid=86893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 08:22:18 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-eab5bf68-0194-4d6f-9d8b-d47c172f2d00 req-e506fc11-7dc6-4ed2-8942-fc693fdad30d tempest-AttachVolumeNegativeTest-1390424861 None] attachment_update completed successfully. Sep 01 08:22:18 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-23847f64-81da-4784-b4a4-4f7f5cb0a222 req-4202b020-5422-478d-9c72-02d8fe97a372 tempest-AttachVolumeTestJSON-1416367693 None] attachment_update completed successfully. Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Flow 'volume_create_manager' (caf15862-7291-4bee-bed9-ac57c7947095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9c8fc1a-06e2-4218-ab65-b954ef05e881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9c8fc1a-06e2-4218-ab65-b954ef05e881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-653692934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45495268-85ee-4d74-9817-8dc1fae4e303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf6888f9d3943e88cf55332c940ecbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:19Z,use_quota=True,user_id='a7da3e78362f4823933e634bddbc59b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d28eec4d-f697-43f9-98e8-c6746e79ce71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d28eec4d-f697-43f9-98e8-c6746e79ce71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f609d32f-a60b-456c-b246-226a2626d1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f609d32f-a60b-456c-b246-226a2626d1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45495268-85ee-4d74-9817-8dc1fae4e303', 'volume_name': 'volume-45495268-85ee-4d74-9817-8dc1fae4e303', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c68e6987-f27d-4fda-9e14-d2dc3814b06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c68e6987-f27d-4fda-9e14-d2dc3814b06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69dc17a-1323-47b0-a820-ddcb82d3527e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:19 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Volume 45495268-85ee-4d74-9817-8dc1fae4e303: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45495268-85ee-4d74-9817-8dc1fae4e303', 'volume_size': 1} Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-653692934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45495268-85ee-4d74-9817-8dc1fae4e303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf6888f9d3943e88cf55332c940ecbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:19Z,use_quota=True,user_id='a7da3e78362f4823933e634bddbc59b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Creating volume 45495268-85ee-4d74-9817-8dc1fae4e303 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:22:19 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45495268-85ee-4d74-9817-8dc1fae4e303 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:19 devstack sudo[97579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45495268-85ee-4d74-9817-8dc1fae4e303 1073741824 Sep 01 08:22:19 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Flow 'volume_create_manager' (2b2c7736-34ad-4372-b57d-530a982a5347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca04b68b-ac1c-4fb3-9d0c-4f9e7e43811f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca04b68b-ac1c-4fb3-9d0c-4f9e7e43811f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-799427072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80ee9a13-22ba-408a-b0f0-d99ff6fff38e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf6888f9d3943e88cf55332c940ecbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:20Z,use_quota=True,user_id='a7da3e78362f4823933e634bddbc59b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (421bc532-a323-49b4-b6a6-2d2cb2e144f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (421bc532-a323-49b4-b6a6-2d2cb2e144f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b6feb0-a944-435d-bda8-19e09cc7ba13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b6feb0-a944-435d-bda8-19e09cc7ba13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80ee9a13-22ba-408a-b0f0-d99ff6fff38e', 'volume_name': 'volume-80ee9a13-22ba-408a-b0f0-d99ff6fff38e', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f387e276-918f-467a-8f55-ee4d02e4df0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f387e276-918f-467a-8f55-ee4d02e4df0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65841530-038e-4359-8bfc-c3a52aa5db0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:19 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Volume 80ee9a13-22ba-408a-b0f0-d99ff6fff38e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80ee9a13-22ba-408a-b0f0-d99ff6fff38e', 'volume_size': 1} Sep 01 08:22:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:20 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45495268-85ee-4d74-9817-8dc1fae4e303 1073741824" returned: 0 in 0.801s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45495268-85ee-4d74-9817-8dc1fae4e303 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:20 devstack sudo[97585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45495268-85ee-4d74-9817-8dc1fae4e303 Sep 01 08:22:20 devstack sudo[97585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:20 devstack sudo[97585]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45495268-85ee-4d74-9817-8dc1fae4e303" returned: 0 in 0.416s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:22:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.593s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-799427072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80ee9a13-22ba-408a-b0f0-d99ff6fff38e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf6888f9d3943e88cf55332c940ecbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:20Z,use_quota=True,user_id='a7da3e78362f4823933e634bddbc59b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:22:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Creating volume 80ee9a13-22ba-408a-b0f0-d99ff6fff38e {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:22:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:22:20 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:22:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-80ee9a13-22ba-408a-b0f0-d99ff6fff38e 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:20 devstack sudo[97589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-80ee9a13-22ba-408a-b0f0-d99ff6fff38e 1073741824 Sep 01 08:22:20 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69dc17a-1323-47b0-a820-ddcb82d3527e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45495268-85ee-4d74-9817-8dc1fae4e303', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37eeeff6-0933-4c7a-a120-33876404250a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:20 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Volume volume-45495268-85ee-4d74-9817-8dc1fae4e303 (45495268-85ee-4d74-9817-8dc1fae4e303): created successfully Sep 01 08:22:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37eeeff6-0933-4c7a-a120-33876404250a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Flow 'volume_create_manager' (caf15862-7291-4bee-bed9-ac57c7947095) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:20 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:22:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] Flow 'volume_create_manager' (62f44e4a-14a9-4a11-8b08-d3a440476d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd98c19-275b-4387-93e6-34467f388a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:20 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-daed3cae-a28c-432a-8ad6-a6e3ca16d9f0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Created volume successfully. Sep 01 08:22:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd98c19-275b-4387-93e6-34467f388a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-66750163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e381a565-6bf1-4f3c-800d-65c17a239a7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf6888f9d3943e88cf55332c940ecbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:21Z,use_quota=True,user_id='a7da3e78362f4823933e634bddbc59b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22f986c0-f658-425e-b42b-0d565c63d1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22f986c0-f658-425e-b42b-0d565c63d1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed88f9e-0ec2-4f8a-8e7c-6113fb744a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed88f9e-0ec2-4f8a-8e7c-6113fb744a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e381a565-6bf1-4f3c-800d-65c17a239a7c', 'volume_name': 'volume-e381a565-6bf1-4f3c-800d-65c17a239a7c', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8851d7f8-f663-4731-a06f-781d7fa70176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8851d7f8-f663-4731-a06f-781d7fa70176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c7904ef-c767-44b8-ac34-7f2827cee67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:20 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] Volume e381a565-6bf1-4f3c-800d-65c17a239a7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e381a565-6bf1-4f3c-800d-65c17a239a7c', 'volume_size': 1} Sep 01 08:22:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] Flow 'volume_create_manager' (02b7c33d-9372-41e2-b1ca-a467f49a76b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aef276d7-3e45-4e9b-a3a9-2cc6de9de935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aef276d7-3e45-4e9b-a3a9-2cc6de9de935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1314202970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41bc5533-140b-4884-bb66-c5be7f6f8567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b1cc159fd140dab302988a1741d63e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:21Z,use_quota=True,user_id='5c502c57d18c44c7a031d8149a6c4f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f820c1-6e65-4d6d-a40e-c13ad1ee7c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f820c1-6e65-4d6d-a40e-c13ad1ee7c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c07d133-c126-4b61-aab1-5a7b82f33e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c07d133-c126-4b61-aab1-5a7b82f33e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41bc5533-140b-4884-bb66-c5be7f6f8567', 'volume_name': 'volume-41bc5533-140b-4884-bb66-c5be7f6f8567', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74382301-7ec4-4c50-b817-f2fa1cb39cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74382301-7ec4-4c50-b817-f2fa1cb39cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bebede6f-d6b9-4d73-9203-02f0c6ba2660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:21 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] Volume 41bc5533-140b-4884-bb66-c5be7f6f8567: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41bc5533-140b-4884-bb66-c5be7f6f8567', 'volume_size': 1} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Flow 'volume_create_manager' (005dd4fe-cc9a-40ca-af26-05a6d265df46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fddd2eea-93be-47d4-9ac5-d0b6b90cfaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:21 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fddd2eea-93be-47d4-9ac5-d0b6b90cfaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-437039296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3d2b86-59a0-44a6-8b5b-2eea58ec123c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf6888f9d3943e88cf55332c940ecbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:21Z,use_quota=True,user_id='a7da3e78362f4823933e634bddbc59b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3c1a08e-342d-4f19-8c75-5191b06729da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3c1a08e-342d-4f19-8c75-5191b06729da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba178a9c-2867-4764-8ecc-00d4e1e33748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba178a9c-2867-4764-8ecc-00d4e1e33748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a3d2b86-59a0-44a6-8b5b-2eea58ec123c', 'volume_name': 'volume-9a3d2b86-59a0-44a6-8b5b-2eea58ec123c', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80bf2727-7e4c-48c1-afa4-04896e57f0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80bf2727-7e4c-48c1-afa4-04896e57f0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffd2a189-e79e-483a-ab68-3bec8d9576f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:21 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Volume 9a3d2b86-59a0-44a6-8b5b-2eea58ec123c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a3d2b86-59a0-44a6-8b5b-2eea58ec123c', 'volume_size': 1} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-80ee9a13-22ba-408a-b0f0-d99ff6fff38e 1073741824" returned: 0 in 0.830s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-80ee9a13-22ba-408a-b0f0-d99ff6fff38e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:21 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-80ee9a13-22ba-408a-b0f0-d99ff6fff38e Sep 01 08:22:21 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:21 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-20e02fdd-57bc-4f33-b9c5-0d585e16cdf4 req-66f39c8c-2d85-4a8b-96d8-62992c6a78d1 tempest-AttachVolumeNegativeTest-1390424861 None] Terminate volume connection completed successfully. Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-20e02fdd-57bc-4f33-b9c5-0d585e16cdf4 req-66f39c8c-2d85-4a8b-96d8-62992c6a78d1 tempest-AttachVolumeNegativeTest-1390424861 None] Deleting attachment b87176e1-ac5f-45b1-8a42-332e3d99d994. {{(pid=86893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Flow 'volume_create_manager' (33675f49-728f-45cb-a542-eecfc3a35158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82242a2d-ba65-4771-88e4-f5d6db0f32d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:21 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-80ee9a13-22ba-408a-b0f0-d99ff6fff38e" returned: 0 in 0.382s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.032s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-66750163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e381a565-6bf1-4f3c-800d-65c17a239a7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf6888f9d3943e88cf55332c940ecbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:21Z,use_quota=True,user_id='a7da3e78362f4823933e634bddbc59b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] Creating volume e381a565-6bf1-4f3c-800d-65c17a239a7c {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:22:21 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e381a565-6bf1-4f3c-800d-65c17a239a7c 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82242a2d-ba65-4771-88e4-f5d6db0f32d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1864803836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d12e740-34bb-4d5c-a124-cac5739bdcd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf6888f9d3943e88cf55332c940ecbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:22Z,use_quota=True,user_id='a7da3e78362f4823933e634bddbc59b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (874958a5-0036-49e7-aa59-9974151af183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (874958a5-0036-49e7-aa59-9974151af183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c237aa-36d5-4451-96f7-055f5fb6c3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:21 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e381a565-6bf1-4f3c-800d-65c17a239a7c 1073741824 Sep 01 08:22:21 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c237aa-36d5-4451-96f7-055f5fb6c3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d12e740-34bb-4d5c-a124-cac5739bdcd2', 'volume_name': 'volume-8d12e740-34bb-4d5c-a124-cac5739bdcd2', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af21ec62-e597-49b1-8c5d-88ad6b383c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af21ec62-e597-49b1-8c5d-88ad6b383c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac468080-6e55-4d84-974a-fb0a128ceadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:21 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Volume 8d12e740-34bb-4d5c-a124-cac5739bdcd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d12e740-34bb-4d5c-a124-cac5739bdcd2', 'volume_size': 1} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65841530-038e-4359-8bfc-c3a52aa5db0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80ee9a13-22ba-408a-b0f0-d99ff6fff38e', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799a72b9-ba2f-49bf-82f3-b7f0437a33f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:21 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Volume volume-80ee9a13-22ba-408a-b0f0-d99ff6fff38e (80ee9a13-22ba-408a-b0f0-d99ff6fff38e): created successfully Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799a72b9-ba2f-49bf-82f3-b7f0437a33f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Flow 'volume_create_manager' (2b2c7736-34ad-4372-b57d-530a982a5347) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:21 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-f4dddf59-83e4-4002-8561-a429511d09a9 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Created volume successfully. Sep 01 08:22:22 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e381a565-6bf1-4f3c-800d-65c17a239a7c 1073741824" returned: 0 in 0.512s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e381a565-6bf1-4f3c-800d-65c17a239a7c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:22 devstack sudo[97609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e381a565-6bf1-4f3c-800d-65c17a239a7c Sep 01 08:22:22 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:22 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e381a565-6bf1-4f3c-800d-65c17a239a7c" returned: 0 in 0.311s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:22:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.471s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1314202970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41bc5533-140b-4884-bb66-c5be7f6f8567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b1cc159fd140dab302988a1741d63e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:21Z,use_quota=True,user_id='5c502c57d18c44c7a031d8149a6c4f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:22:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] Creating volume 41bc5533-140b-4884-bb66-c5be7f6f8567 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:22:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:22:22 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:22:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-41bc5533-140b-4884-bb66-c5be7f6f8567 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:22 devstack sudo[97613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-41bc5533-140b-4884-bb66-c5be7f6f8567 1073741824 Sep 01 08:22:22 devstack sudo[97613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c7904ef-c767-44b8-ac34-7f2827cee67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e381a565-6bf1-4f3c-800d-65c17a239a7c', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc22b73b-e92d-4648-a71b-894d8cd5bcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:22 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] Volume volume-e381a565-6bf1-4f3c-800d-65c17a239a7c (e381a565-6bf1-4f3c-800d-65c17a239a7c): created successfully Sep 01 08:22:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc22b73b-e92d-4648-a71b-894d8cd5bcb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] Flow 'volume_create_manager' (62f44e4a-14a9-4a11-8b08-d3a440476d82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:22 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-d561c9e4-1ff8-4919-9c10-ce660903b48e tempest-CreateVolumesFromSnapshotTest-1966592782 None] Created volume successfully. Sep 01 08:22:23 devstack sudo[97613]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-41bc5533-140b-4884-bb66-c5be7f6f8567 1073741824" returned: 0 in 0.745s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-41bc5533-140b-4884-bb66-c5be7f6f8567 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:23 devstack sudo[97640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-41bc5533-140b-4884-bb66-c5be7f6f8567 Sep 01 08:22:23 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:23 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-41bc5533-140b-4884-bb66-c5be7f6f8567" returned: 0 in 0.322s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:23 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:22:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.432s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:23 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-437039296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3d2b86-59a0-44a6-8b5b-2eea58ec123c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf6888f9d3943e88cf55332c940ecbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:21Z,use_quota=True,user_id='a7da3e78362f4823933e634bddbc59b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:22:23 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Creating volume 9a3d2b86-59a0-44a6-8b5b-2eea58ec123c {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:22:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:23 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:23 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:23 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:22:23 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:22:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9a3d2b86-59a0-44a6-8b5b-2eea58ec123c 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:23 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bebede6f-d6b9-4d73-9203-02f0c6ba2660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41bc5533-140b-4884-bb66-c5be7f6f8567', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:23 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb56724-3604-4cc8-a406-3e5a9f93b147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:23 devstack sudo[97644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9a3d2b86-59a0-44a6-8b5b-2eea58ec123c 1073741824 Sep 01 08:22:23 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:23 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] Volume volume-41bc5533-140b-4884-bb66-c5be7f6f8567 (41bc5533-140b-4884-bb66-c5be7f6f8567): created successfully Sep 01 08:22:23 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb56724-3604-4cc8-a406-3e5a9f93b147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:23 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] Flow 'volume_create_manager' (02b7c33d-9372-41e2-b1ca-a467f49a76b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:23 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-c9607075-c2c2-4419-aa02-75914a175f2d tempest-AttachVolumeTestJSON-1416367693 None] Created volume successfully. Sep 01 08:22:24 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9a3d2b86-59a0-44a6-8b5b-2eea58ec123c 1073741824" returned: 0 in 0.667s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9a3d2b86-59a0-44a6-8b5b-2eea58ec123c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:24 devstack sudo[97660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9a3d2b86-59a0-44a6-8b5b-2eea58ec123c Sep 01 08:22:24 devstack sudo[97660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:24 devstack sudo[97660]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9a3d2b86-59a0-44a6-8b5b-2eea58ec123c" returned: 0 in 0.268s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:24 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:22:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.929s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:24 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1864803836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d12e740-34bb-4d5c-a124-cac5739bdcd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf6888f9d3943e88cf55332c940ecbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:22Z,use_quota=True,user_id='a7da3e78362f4823933e634bddbc59b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:22:24 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Creating volume 8d12e740-34bb-4d5c-a124-cac5739bdcd2 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:22:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:24 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:24 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:24 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:22:24 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:22:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8d12e740-34bb-4d5c-a124-cac5739bdcd2 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:24 devstack sudo[97663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8d12e740-34bb-4d5c-a124-cac5739bdcd2 1073741824 Sep 01 08:22:24 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffd2a189-e79e-483a-ab68-3bec8d9576f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a3d2b86-59a0-44a6-8b5b-2eea58ec123c', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17db81ec-a5f7-4383-a27c-2086f10ab2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:24 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Volume volume-9a3d2b86-59a0-44a6-8b5b-2eea58ec123c (9a3d2b86-59a0-44a6-8b5b-2eea58ec123c): created successfully Sep 01 08:22:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17db81ec-a5f7-4383-a27c-2086f10ab2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Flow 'volume_create_manager' (005dd4fe-cc9a-40ca-af26-05a6d265df46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:25 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-8ac0488c-366c-4d67-8366-f432c02bd243 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Created volume successfully. Sep 01 08:22:25 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8d12e740-34bb-4d5c-a124-cac5739bdcd2 1073741824" returned: 0 in 0.843s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8d12e740-34bb-4d5c-a124-cac5739bdcd2 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:25 devstack sudo[97676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8d12e740-34bb-4d5c-a124-cac5739bdcd2 Sep 01 08:22:25 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-d839b702-aaa4-4226-a6c3-e20d99c42a71 req-facfd749-9c20-42c9-8994-4119ba26e690 tempest-AttachVolumeTestJSON-1416367693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:26 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8d12e740-34bb-4d5c-a124-cac5739bdcd2" returned: 0 in 0.280s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:26 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:22:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-d839b702-aaa4-4226-a6c3-e20d99c42a71 req-facfd749-9c20-42c9-8994-4119ba26e690 tempest-AttachVolumeTestJSON-1416367693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.050s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac468080-6e55-4d84-974a-fb0a128ceadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d12e740-34bb-4d5c-a124-cac5739bdcd2', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf8c547e-0c7d-456b-a0c7-e88e005a76e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-d839b702-aaa4-4226-a6c3-e20d99c42a71 req-facfd749-9c20-42c9-8994-4119ba26e690 tempest-AttachVolumeTestJSON-1416367693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:26 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Volume volume-8d12e740-34bb-4d5c-a124-cac5739bdcd2 (8d12e740-34bb-4d5c-a124-cac5739bdcd2): created successfully Sep 01 08:22:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf8c547e-0c7d-456b-a0c7-e88e005a76e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Flow 'volume_create_manager' (33675f49-728f-45cb-a542-eecfc3a35158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:26 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-e3e07201-3508-4258-9ae8-dceee098b619 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Created volume successfully. Sep 01 08:22:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-d839b702-aaa4-4226-a6c3-e20d99c42a71 req-facfd749-9c20-42c9-8994-4119ba26e690 tempest-AttachVolumeTestJSON-1416367693 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049', 'name': 'volume-41bc5533-140b-4884-bb66-c5be7f6f8567', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '06e08b79-efc1-4f3a-8544-966b3453c7df', 'enforce_multipath': True} {{(pid=86893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 08:22:26 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-d839b702-aaa4-4226-a6c3-e20d99c42a71 req-facfd749-9c20-42c9-8994-4119ba26e690 tempest-AttachVolumeTestJSON-1416367693 None] attachment_update completed successfully. Sep 01 08:22:26 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-5a7cf88e-1864-4c7e-baa2-c99bd288e6ee tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "cinder-8d12e740-34bb-4d5c-a124-cac5739bdcd2-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:26 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-5a7cf88e-1864-4c7e-baa2-c99bd288e6ee tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "cinder-8d12e740-34bb-4d5c-a124-cac5739bdcd2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:26 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-5a7cf88e-1864-4c7e-baa2-c99bd288e6ee tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "cinder-quobyte-8d12e740-34bb-4d5c-a124-cac5739bdcd2" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:26 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-5a7cf88e-1864-4c7e-baa2-c99bd288e6ee tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "cinder-quobyte-8d12e740-34bb-4d5c-a124-cac5739bdcd2" acquired by "delete_volume" :: waited 0.026s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:26 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f2e85a-2f03-482c-bd13-74a3db2a8b39]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:22:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5a7cf88e-1864-4c7e-baa2-c99bd288e6ee tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8d12e740-34bb-4d5c-a124-cac5739bdcd2 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:26 devstack sudo[97685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8d12e740-34bb-4d5c-a124-cac5739bdcd2 Sep 01 08:22:26 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:27 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5a7cf88e-1864-4c7e-baa2-c99bd288e6ee tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8d12e740-34bb-4d5c-a124-cac5739bdcd2" returned: 0 in 0.436s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5a7cf88e-1864-4c7e-baa2-c99bd288e6ee tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8d12e740-34bb-4d5c-a124-cac5739bdcd2 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:27 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8d12e740-34bb-4d5c-a124-cac5739bdcd2 Sep 01 08:22:27 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:27 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5a7cf88e-1864-4c7e-baa2-c99bd288e6ee tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8d12e740-34bb-4d5c-a124-cac5739bdcd2" returned: 0 in 0.311s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:27 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-5a7cf88e-1864-4c7e-baa2-c99bd288e6ee tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "cinder-quobyte-8d12e740-34bb-4d5c-a124-cac5739bdcd2" released by "delete_volume" :: held 0.822s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:27 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-5a7cf88e-1864-4c7e-baa2-c99bd288e6ee tempest-CreateVolumesFromSnapshotTest-1966592782 None] Created reservations ['c89d7003-8c4e-4564-bb71-62792f9d23c9', '790ff337-9179-4864-959e-238009869838', '78297ba0-cd2d-4512-8cef-ebb08b08ffb8', '398f6946-fdca-4524-b51e-78a3611303ca'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:22:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5a7cf88e-1864-4c7e-baa2-c99bd288e6ee tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5a7cf88e-1864-4c7e-baa2-c99bd288e6ee tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-5a7cf88e-1864-4c7e-baa2-c99bd288e6ee tempest-CreateVolumesFromSnapshotTest-1966592782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-5a7cf88e-1864-4c7e-baa2-c99bd288e6ee tempest-CreateVolumesFromSnapshotTest-1966592782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5a7cf88e-1864-4c7e-baa2-c99bd288e6ee tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5a7cf88e-1864-4c7e-baa2-c99bd288e6ee tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:27 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:22:27 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:27 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b27c2367-3ef4-4e76-a98c-5412705ec1e1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "cinder-9a3d2b86-59a0-44a6-8b5b-2eea58ec123c-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:27 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b27c2367-3ef4-4e76-a98c-5412705ec1e1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "cinder-9a3d2b86-59a0-44a6-8b5b-2eea58ec123c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b27c2367-3ef4-4e76-a98c-5412705ec1e1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "cinder-quobyte-9a3d2b86-59a0-44a6-8b5b-2eea58ec123c" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b27c2367-3ef4-4e76-a98c-5412705ec1e1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "cinder-quobyte-9a3d2b86-59a0-44a6-8b5b-2eea58ec123c" acquired by "delete_volume" :: waited 0.037s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:28 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed9fc1f-f12c-4a02-8ce8-2d721afcfc0e]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:22:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b27c2367-3ef4-4e76-a98c-5412705ec1e1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9a3d2b86-59a0-44a6-8b5b-2eea58ec123c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:28 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5a7cf88e-1864-4c7e-baa2-c99bd288e6ee tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.385s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:28 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-5a7cf88e-1864-4c7e-baa2-c99bd288e6ee tempest-CreateVolumesFromSnapshotTest-1966592782 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:22:28 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-5a7cf88e-1864-4c7e-baa2-c99bd288e6ee tempest-CreateVolumesFromSnapshotTest-1966592782 None] Deleted volume successfully. Sep 01 08:22:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-cfefe61d-fbb0-4e8a-9dbc-554ca7561aa6 tempest-AttachVolumeNegativeTest-1390424861 None] Acquiring lock "cinder-70dc04de-dba3-4381-9fd8-441a70d18eee-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-5a7cf88e-1864-4c7e-baa2-c99bd288e6ee tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "cinder-8d12e740-34bb-4d5c-a124-cac5739bdcd2-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-cfefe61d-fbb0-4e8a-9dbc-554ca7561aa6 tempest-AttachVolumeNegativeTest-1390424861 None] Lock "cinder-70dc04de-dba3-4381-9fd8-441a70d18eee-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-cfefe61d-fbb0-4e8a-9dbc-554ca7561aa6 tempest-AttachVolumeNegativeTest-1390424861 None] Acquiring lock "cinder-quobyte-70dc04de-dba3-4381-9fd8-441a70d18eee" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-cfefe61d-fbb0-4e8a-9dbc-554ca7561aa6 tempest-AttachVolumeNegativeTest-1390424861 None] Lock "cinder-quobyte-70dc04de-dba3-4381-9fd8-441a70d18eee" acquired by "delete_volume" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:28 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9a3d2b86-59a0-44a6-8b5b-2eea58ec123c Sep 01 08:22:28 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:28 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[07420edb-c93b-4215-9ab4-59fb8a0ded04]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:22:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cfefe61d-fbb0-4e8a-9dbc-554ca7561aa6 tempest-AttachVolumeNegativeTest-1390424861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-70dc04de-dba3-4381-9fd8-441a70d18eee {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:28 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-70dc04de-dba3-4381-9fd8-441a70d18eee Sep 01 08:22:28 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:28 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b27c2367-3ef4-4e76-a98c-5412705ec1e1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9a3d2b86-59a0-44a6-8b5b-2eea58ec123c" returned: 0 in 0.485s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b27c2367-3ef4-4e76-a98c-5412705ec1e1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9a3d2b86-59a0-44a6-8b5b-2eea58ec123c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:28 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9a3d2b86-59a0-44a6-8b5b-2eea58ec123c Sep 01 08:22:28 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:28 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cfefe61d-fbb0-4e8a-9dbc-554ca7561aa6 tempest-AttachVolumeNegativeTest-1390424861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-70dc04de-dba3-4381-9fd8-441a70d18eee" returned: 0 in 0.570s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cfefe61d-fbb0-4e8a-9dbc-554ca7561aa6 tempest-AttachVolumeNegativeTest-1390424861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-70dc04de-dba3-4381-9fd8-441a70d18eee {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:28 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-70dc04de-dba3-4381-9fd8-441a70d18eee Sep 01 08:22:28 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:28 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b27c2367-3ef4-4e76-a98c-5412705ec1e1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9a3d2b86-59a0-44a6-8b5b-2eea58ec123c" returned: 0 in 0.399s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:29 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b27c2367-3ef4-4e76-a98c-5412705ec1e1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "cinder-quobyte-9a3d2b86-59a0-44a6-8b5b-2eea58ec123c" released by "delete_volume" :: held 0.949s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:29 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-b27c2367-3ef4-4e76-a98c-5412705ec1e1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Created reservations ['92a4432f-1bc2-4492-912f-8918482e3221', '47df686f-3859-459c-b26e-3df029ea8e8a', 'b41075df-c5e3-4991-8f7c-d9b5f6b01688', 'c2b06bea-4921-460d-aaeb-267d764259d8'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:22:29 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cfefe61d-fbb0-4e8a-9dbc-554ca7561aa6 tempest-AttachVolumeNegativeTest-1390424861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-70dc04de-dba3-4381-9fd8-441a70d18eee" returned: 0 in 0.307s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b27c2367-3ef4-4e76-a98c-5412705ec1e1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b27c2367-3ef4-4e76-a98c-5412705ec1e1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b27c2367-3ef4-4e76-a98c-5412705ec1e1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b27c2367-3ef4-4e76-a98c-5412705ec1e1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b27c2367-3ef4-4e76-a98c-5412705ec1e1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b27c2367-3ef4-4e76-a98c-5412705ec1e1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:29 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:22:29 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:29 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-cfefe61d-fbb0-4e8a-9dbc-554ca7561aa6 tempest-AttachVolumeNegativeTest-1390424861 None] Lock "cinder-quobyte-70dc04de-dba3-4381-9fd8-441a70d18eee" released by "delete_volume" :: held 0.961s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:29 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-2f01cbdb-701c-44db-b1ee-cea9eabf322c req-599d7409-7ed8-4461-bcc0-dbc15c84e908 tempest-AttachVolumeTestJSON-1416367693 None] Terminate volume connection completed successfully. Sep 01 08:22:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-2f01cbdb-701c-44db-b1ee-cea9eabf322c req-599d7409-7ed8-4461-bcc0-dbc15c84e908 tempest-AttachVolumeTestJSON-1416367693 None] Deleting attachment b937dd59-962b-40ec-b353-dee185beafc0. {{(pid=86893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 08:22:29 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-cfefe61d-fbb0-4e8a-9dbc-554ca7561aa6 tempest-AttachVolumeNegativeTest-1390424861 None] Created reservations ['3508d549-3b05-4641-b2bd-17d22202e9f7', '4200ca68-7866-40ce-bf11-2e4970555baa', '986a5e5e-5f92-4b4f-a89b-10b1585e4767', 'd87128b4-f349-4c7d-aece-ee65f1d93191'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:22:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-cfefe61d-fbb0-4e8a-9dbc-554ca7561aa6 tempest-AttachVolumeNegativeTest-1390424861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-cfefe61d-fbb0-4e8a-9dbc-554ca7561aa6 tempest-AttachVolumeNegativeTest-1390424861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-cfefe61d-fbb0-4e8a-9dbc-554ca7561aa6 tempest-AttachVolumeNegativeTest-1390424861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-cfefe61d-fbb0-4e8a-9dbc-554ca7561aa6 tempest-AttachVolumeNegativeTest-1390424861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-cfefe61d-fbb0-4e8a-9dbc-554ca7561aa6 tempest-AttachVolumeNegativeTest-1390424861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cfefe61d-fbb0-4e8a-9dbc-554ca7561aa6 tempest-AttachVolumeNegativeTest-1390424861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:29 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:22:29 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:29 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b27c2367-3ef4-4e76-a98c-5412705ec1e1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.337s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:29 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-b27c2367-3ef4-4e76-a98c-5412705ec1e1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:22:29 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-b27c2367-3ef4-4e76-a98c-5412705ec1e1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Deleted volume successfully. Sep 01 08:22:29 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b27c2367-3ef4-4e76-a98c-5412705ec1e1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "cinder-9a3d2b86-59a0-44a6-8b5b-2eea58ec123c-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:29 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cfefe61d-fbb0-4e8a-9dbc-554ca7561aa6 tempest-AttachVolumeNegativeTest-1390424861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.331s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:29 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-cfefe61d-fbb0-4e8a-9dbc-554ca7561aa6 tempest-AttachVolumeNegativeTest-1390424861 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:22:29 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-cfefe61d-fbb0-4e8a-9dbc-554ca7561aa6 tempest-AttachVolumeNegativeTest-1390424861 None] Deleted volume successfully. Sep 01 08:22:29 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-cfefe61d-fbb0-4e8a-9dbc-554ca7561aa6 tempest-AttachVolumeNegativeTest-1390424861 None] Lock "cinder-70dc04de-dba3-4381-9fd8-441a70d18eee-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:30 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ee62c24d-f309-4112-8374-8073c98977b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "cinder-e381a565-6bf1-4f3c-800d-65c17a239a7c-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:30 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ee62c24d-f309-4112-8374-8073c98977b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "cinder-e381a565-6bf1-4f3c-800d-65c17a239a7c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:30 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ee62c24d-f309-4112-8374-8073c98977b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "cinder-quobyte-e381a565-6bf1-4f3c-800d-65c17a239a7c" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:30 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ee62c24d-f309-4112-8374-8073c98977b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "cinder-quobyte-e381a565-6bf1-4f3c-800d-65c17a239a7c" acquired by "delete_volume" :: waited 0.025s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:30 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32d74f1-b87a-4588-9896-472adf3b0706]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:22:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ee62c24d-f309-4112-8374-8073c98977b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e381a565-6bf1-4f3c-800d-65c17a239a7c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:30 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e381a565-6bf1-4f3c-800d-65c17a239a7c Sep 01 08:22:30 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:30 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0b793178-2e1b-49c9-8b8b-dff0c12ed0fd tempest-AttachVolumeNegativeTest-1390424861 None] Acquiring lock "cinder-b55b11b3-1e3a-4e97-806f-a5e7e8070a9b-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:30 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0b793178-2e1b-49c9-8b8b-dff0c12ed0fd tempest-AttachVolumeNegativeTest-1390424861 None] Lock "cinder-b55b11b3-1e3a-4e97-806f-a5e7e8070a9b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:30 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-554f33a2-400f-4336-857b-a60dc4da42ef req-9929094f-b09e-40ad-bf6a-6196d2d9eeb9 tempest-AttachVolumeTestJSON-1416367693 None] Terminate volume connection completed successfully. Sep 01 08:22:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-554f33a2-400f-4336-857b-a60dc4da42ef req-9929094f-b09e-40ad-bf6a-6196d2d9eeb9 tempest-AttachVolumeTestJSON-1416367693 None] Deleting attachment 06e08b79-efc1-4f3a-8544-966b3453c7df. {{(pid=86893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 08:22:30 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0b793178-2e1b-49c9-8b8b-dff0c12ed0fd tempest-AttachVolumeNegativeTest-1390424861 None] Acquiring lock "cinder-quobyte-b55b11b3-1e3a-4e97-806f-a5e7e8070a9b" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:30 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0b793178-2e1b-49c9-8b8b-dff0c12ed0fd tempest-AttachVolumeNegativeTest-1390424861 None] Lock "cinder-quobyte-b55b11b3-1e3a-4e97-806f-a5e7e8070a9b" acquired by "delete_volume" :: waited 0.023s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:30 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b730e3d-39b2-4745-a472-e9845685c60b]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:22:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0b793178-2e1b-49c9-8b8b-dff0c12ed0fd tempest-AttachVolumeNegativeTest-1390424861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b55b11b3-1e3a-4e97-806f-a5e7e8070a9b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:30 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ee62c24d-f309-4112-8374-8073c98977b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e381a565-6bf1-4f3c-800d-65c17a239a7c" returned: 0 in 0.528s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ee62c24d-f309-4112-8374-8073c98977b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e381a565-6bf1-4f3c-800d-65c17a239a7c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:30 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b55b11b3-1e3a-4e97-806f-a5e7e8070a9b Sep 01 08:22:30 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:30 devstack sudo[97759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e381a565-6bf1-4f3c-800d-65c17a239a7c Sep 01 08:22:30 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:31 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:22:31 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:31 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ee62c24d-f309-4112-8374-8073c98977b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e381a565-6bf1-4f3c-800d-65c17a239a7c" returned: 0 in 0.268s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ee62c24d-f309-4112-8374-8073c98977b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "cinder-quobyte-e381a565-6bf1-4f3c-800d-65c17a239a7c" released by "delete_volume" :: held 0.860s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:31 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0b793178-2e1b-49c9-8b8b-dff0c12ed0fd tempest-AttachVolumeNegativeTest-1390424861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b55b11b3-1e3a-4e97-806f-a5e7e8070a9b" returned: 0 in 0.443s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0b793178-2e1b-49c9-8b8b-dff0c12ed0fd tempest-AttachVolumeNegativeTest-1390424861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b55b11b3-1e3a-4e97-806f-a5e7e8070a9b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:31 devstack sudo[97767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b55b11b3-1e3a-4e97-806f-a5e7e8070a9b Sep 01 08:22:31 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-ee62c24d-f309-4112-8374-8073c98977b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Created reservations ['a5239d44-a9c5-44b1-bc95-aee52c6ab541', '76868d87-c192-481f-ae03-6d21b2819f7a', 'cb93ec07-475d-4d0a-ac9a-26935776df1e', '87a505b9-05b1-4b45-adb8-1464d5c6e259'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:22:31 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.325s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager._thread_info {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread count: 28 {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread info: [<_MainThread(MainThread, started 138934582050944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ee62c24d-f309-4112-8374-8073c98977b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ee62c24d-f309-4112-8374-8073c98977b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ee62c24d-f309-4112-8374-8073c98977b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ee62c24d-f309-4112-8374-8073c98977b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ee62c24d-f309-4112-8374-8073c98977b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ee62c24d-f309-4112-8374-8073c98977b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:31 devstack sudo[97770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:22:31 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-179fa0df-7a39-4155-8473-767968bb393f tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "cinder-80ee9a13-22ba-408a-b0f0-d99ff6fff38e-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-179fa0df-7a39-4155-8473-767968bb393f tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "cinder-80ee9a13-22ba-408a-b0f0-d99ff6fff38e-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:31 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0b793178-2e1b-49c9-8b8b-dff0c12ed0fd tempest-AttachVolumeNegativeTest-1390424861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b55b11b3-1e3a-4e97-806f-a5e7e8070a9b" returned: 0 in 0.400s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-179fa0df-7a39-4155-8473-767968bb393f tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "cinder-quobyte-80ee9a13-22ba-408a-b0f0-d99ff6fff38e" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0b793178-2e1b-49c9-8b8b-dff0c12ed0fd tempest-AttachVolumeNegativeTest-1390424861 None] Lock "cinder-quobyte-b55b11b3-1e3a-4e97-806f-a5e7e8070a9b" released by "delete_volume" :: held 0.964s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-179fa0df-7a39-4155-8473-767968bb393f tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "cinder-quobyte-80ee9a13-22ba-408a-b0f0-d99ff6fff38e" acquired by "delete_volume" :: waited 0.051s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2fd22c-a976-4fbd-a66f-e828b83d75c3]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-179fa0df-7a39-4155-8473-767968bb393f tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-80ee9a13-22ba-408a-b0f0-d99ff6fff38e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-0b793178-2e1b-49c9-8b8b-dff0c12ed0fd tempest-AttachVolumeNegativeTest-1390424861 None] Created reservations ['b686ae80-7f5f-4156-81ae-d4dfa05fa2ce', 'b02863cd-2aae-44d6-b084-a9154c66d0af', '8f2ab655-2b99-4000-a9d3-fbf2f2f856c6', 'b85ce41c-ebe9-4fcf-8fa1-6b26a0b7f9e3'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:22:31 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ee62c24d-f309-4112-8374-8073c98977b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.411s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-ee62c24d-f309-4112-8374-8073c98977b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:22:31 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-ee62c24d-f309-4112-8374-8073c98977b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Deleted volume successfully. Sep 01 08:22:31 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-80ee9a13-22ba-408a-b0f0-d99ff6fff38e Sep 01 08:22:31 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:31 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ee62c24d-f309-4112-8374-8073c98977b6 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "cinder-e381a565-6bf1-4f3c-800d-65c17a239a7c-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] Flow 'volume_create_manager' (f3e886e3-5eb9-4005-b594-88f1a3dcb695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b60e6961-cc8a-4761-ac75-495639ff4cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b60e6961-cc8a-4761-ac75-495639ff4cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-399702943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=542b11b1-dd54-4be5-bb4a-b7af3fe63b6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60286168a884a549a8f6a3bba3e078e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:32Z,use_quota=True,user_id='626a43bd39a24fc192843bebe5e731eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7742607-85cc-4012-906b-f1ce7f3aaeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7742607-85cc-4012-906b-f1ce7f3aaeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee562a9d-07a5-42d4-9e3e-af44c5f1903e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee562a9d-07a5-42d4-9e3e-af44c5f1903e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '542b11b1-dd54-4be5-bb4a-b7af3fe63b6c', 'volume_name': 'volume-542b11b1-dd54-4be5-bb4a-b7af3fe63b6c', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe233d1e-4f14-4ed3-9448-ef8e66c8494e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe233d1e-4f14-4ed3-9448-ef8e66c8494e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed670d7e-ec07-45dd-ade6-7993ba198fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:32 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] Volume 542b11b1-dd54-4be5-bb4a-b7af3fe63b6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-542b11b1-dd54-4be5-bb4a-b7af3fe63b6c', 'volume_size': 1} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-399702943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=542b11b1-dd54-4be5-bb4a-b7af3fe63b6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60286168a884a549a8f6a3bba3e078e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:32Z,use_quota=True,user_id='626a43bd39a24fc192843bebe5e731eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] Creating volume 542b11b1-dd54-4be5-bb4a-b7af3fe63b6c {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:22:32 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-542b11b1-dd54-4be5-bb4a-b7af3fe63b6c 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0b793178-2e1b-49c9-8b8b-dff0c12ed0fd tempest-AttachVolumeNegativeTest-1390424861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0b793178-2e1b-49c9-8b8b-dff0c12ed0fd tempest-AttachVolumeNegativeTest-1390424861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0b793178-2e1b-49c9-8b8b-dff0c12ed0fd tempest-AttachVolumeNegativeTest-1390424861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0b793178-2e1b-49c9-8b8b-dff0c12ed0fd tempest-AttachVolumeNegativeTest-1390424861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0b793178-2e1b-49c9-8b8b-dff0c12ed0fd tempest-AttachVolumeNegativeTest-1390424861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0b793178-2e1b-49c9-8b8b-dff0c12ed0fd tempest-AttachVolumeNegativeTest-1390424861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:32 devstack sudo[97776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-542b11b1-dd54-4be5-bb4a-b7af3fe63b6c 1073741824 Sep 01 08:22:32 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:32 devstack sudo[97779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:22:32 devstack sudo[97779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:32 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-179fa0df-7a39-4155-8473-767968bb393f tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-80ee9a13-22ba-408a-b0f0-d99ff6fff38e" returned: 0 in 0.463s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-179fa0df-7a39-4155-8473-767968bb393f tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-80ee9a13-22ba-408a-b0f0-d99ff6fff38e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:32 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-80ee9a13-22ba-408a-b0f0-d99ff6fff38e Sep 01 08:22:32 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:32 devstack sudo[97779]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0b793178-2e1b-49c9-8b8b-dff0c12ed0fd tempest-AttachVolumeNegativeTest-1390424861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.427s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-0b793178-2e1b-49c9-8b8b-dff0c12ed0fd tempest-AttachVolumeNegativeTest-1390424861 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:22:32 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-0b793178-2e1b-49c9-8b8b-dff0c12ed0fd tempest-AttachVolumeNegativeTest-1390424861 None] Deleted volume successfully. Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0b793178-2e1b-49c9-8b8b-dff0c12ed0fd tempest-AttachVolumeNegativeTest-1390424861 None] Lock "cinder-b55b11b3-1e3a-4e97-806f-a5e7e8070a9b-delete_volume" released by "delete_volume" :: held 1.990s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:22:32 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] Flow 'volume_create_manager' (f7175362-bb6c-4445-8ad8-e73168d444a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe81465-09b9-4daa-9656-3c09dfe4fac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-179fa0df-7a39-4155-8473-767968bb393f tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-80ee9a13-22ba-408a-b0f0-d99ff6fff38e" returned: 0 in 0.489s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe81465-09b9-4daa-9656-3c09dfe4fac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-460096659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f83ee1-823f-48ea-a33a-ae54bc77f616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60286168a884a549a8f6a3bba3e078e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:33Z,use_quota=True,user_id='626a43bd39a24fc192843bebe5e731eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e8031f-98a7-421c-b77a-27c98d36712d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e8031f-98a7-421c-b77a-27c98d36712d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf303509-fcf6-4e8a-a765-5a6f281a4b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf303509-fcf6-4e8a-a765-5a6f281a4b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2f83ee1-823f-48ea-a33a-ae54bc77f616', 'volume_name': 'volume-b2f83ee1-823f-48ea-a33a-ae54bc77f616', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92522b6a-63ce-40cc-9880-3a781cb754d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92522b6a-63ce-40cc-9880-3a781cb754d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b2cd569-2fc1-4b0b-a48f-63c0fea286e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:32 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] Volume b2f83ee1-823f-48ea-a33a-ae54bc77f616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2f83ee1-823f-48ea-a33a-ae54bc77f616', 'volume_size': 1} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:32 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-179fa0df-7a39-4155-8473-767968bb393f tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "cinder-quobyte-80ee9a13-22ba-408a-b0f0-d99ff6fff38e" released by "delete_volume" :: held 1.248s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:33 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-542b11b1-dd54-4be5-bb4a-b7af3fe63b6c 1073741824" returned: 0 in 0.983s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-179fa0df-7a39-4155-8473-767968bb393f tempest-CreateVolumesFromSnapshotTest-1966592782 None] Created reservations ['6993625f-f193-4ac7-9997-600a4fa32bd3', '6690fb73-f772-477a-a6e4-fe491b4607ca', 'ff00e919-fb6d-4ceb-8905-bda513d604df', '636c22d6-56ee-4d85-8e45-97c941a903fa'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-542b11b1-dd54-4be5-bb4a-b7af3fe63b6c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:33 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-542b11b1-dd54-4be5-bb4a-b7af3fe63b6c Sep 01 08:22:33 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-179fa0df-7a39-4155-8473-767968bb393f tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-179fa0df-7a39-4155-8473-767968bb393f tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-179fa0df-7a39-4155-8473-767968bb393f tempest-CreateVolumesFromSnapshotTest-1966592782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-179fa0df-7a39-4155-8473-767968bb393f tempest-CreateVolumesFromSnapshotTest-1966592782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-179fa0df-7a39-4155-8473-767968bb393f tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-179fa0df-7a39-4155-8473-767968bb393f tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:33 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:22:33 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] Flow 'volume_create_manager' (ad5b589a-c6c9-4fbd-841c-d7ea80f5e89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1018bcf4-7c31-4041-b3de-a5aad9c94670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ed1c8337-b17a-49e3-94fc-e603c829f44d tempest-AttachVolumeNegativeTest-1390424861 None] Acquiring lock "cinder-035447a2-cff4-47be-97b3-b978338c7039-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1018bcf4-7c31-4041-b3de-a5aad9c94670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1233995866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5722d8-7ec7-492c-8d30-4e95eb15cddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60286168a884a549a8f6a3bba3e078e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:33Z,use_quota=True,user_id='626a43bd39a24fc192843bebe5e731eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca403a72-a16b-4639-aaab-68df63fd3cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:33 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca403a72-a16b-4639-aaab-68df63fd3cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b2a3102-4e80-4e12-912f-b7ab17ef9ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b2a3102-4e80-4e12-912f-b7ab17ef9ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a5722d8-7ec7-492c-8d30-4e95eb15cddc', 'volume_name': 'volume-3a5722d8-7ec7-492c-8d30-4e95eb15cddc', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb5c7ee-6c31-40d9-a37a-7205b20f96b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb5c7ee-6c31-40d9-a37a-7205b20f96b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e070a058-fd2c-4309-bf09-2dd3fe5c13b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:33 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] Volume 3a5722d8-7ec7-492c-8d30-4e95eb15cddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a5722d8-7ec7-492c-8d30-4e95eb15cddc', 'volume_size': 1} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-542b11b1-dd54-4be5-bb4a-b7af3fe63b6c" returned: 0 in 0.421s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.692s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-460096659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f83ee1-823f-48ea-a33a-ae54bc77f616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60286168a884a549a8f6a3bba3e078e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:33Z,use_quota=True,user_id='626a43bd39a24fc192843bebe5e731eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] Creating volume b2f83ee1-823f-48ea-a33a-ae54bc77f616 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:22:33 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b2f83ee1-823f-48ea-a33a-ae54bc77f616 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ed1c8337-b17a-49e3-94fc-e603c829f44d tempest-AttachVolumeNegativeTest-1390424861 None] Lock "cinder-035447a2-cff4-47be-97b3-b978338c7039-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:33 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b2f83ee1-823f-48ea-a33a-ae54bc77f616 1073741824 Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed670d7e-ec07-45dd-ade6-7993ba198fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-542b11b1-dd54-4be5-bb4a-b7af3fe63b6c', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:33 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5646993c-b13f-43b5-b905-073113050b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:33 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] Volume volume-542b11b1-dd54-4be5-bb4a-b7af3fe63b6c (542b11b1-dd54-4be5-bb4a-b7af3fe63b6c): created successfully Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5646993c-b13f-43b5-b905-073113050b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] Flow 'volume_create_manager' (f3e886e3-5eb9-4005-b594-88f1a3dcb695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ed1c8337-b17a-49e3-94fc-e603c829f44d tempest-AttachVolumeNegativeTest-1390424861 None] Acquiring lock "cinder-quobyte-035447a2-cff4-47be-97b3-b978338c7039" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:33 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-8682606c-8b30-4015-bfc0-a5d911739374 tempest-CreateVolumesFromImageTest-597456346 None] Created volume successfully. Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ed1c8337-b17a-49e3-94fc-e603c829f44d tempest-AttachVolumeNegativeTest-1390424861 None] Lock "cinder-quobyte-035447a2-cff4-47be-97b3-b978338c7039" acquired by "delete_volume" :: waited 0.041s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:33 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-179fa0df-7a39-4155-8473-767968bb393f tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.520s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-179fa0df-7a39-4155-8473-767968bb393f tempest-CreateVolumesFromSnapshotTest-1966592782 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae852c0-db14-468c-a140-3f07d594e730]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:22:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ed1c8337-b17a-49e3-94fc-e603c829f44d tempest-AttachVolumeNegativeTest-1390424861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-035447a2-cff4-47be-97b3-b978338c7039 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:33 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-179fa0df-7a39-4155-8473-767968bb393f tempest-CreateVolumesFromSnapshotTest-1966592782 None] Deleted volume successfully. Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-179fa0df-7a39-4155-8473-767968bb393f tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "cinder-80ee9a13-22ba-408a-b0f0-d99ff6fff38e-delete_volume" released by "delete_volume" :: held 2.494s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] Flow 'volume_create_manager' (1142eb8e-4fc3-4de9-8e88-54a3360a625a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d72a359d-c5fd-43a1-bcea-a36d0a696069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d72a359d-c5fd-43a1-bcea-a36d0a696069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1434708045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f57c94a-75ea-4bea-9580-95104118fe3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60286168a884a549a8f6a3bba3e078e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:34Z,use_quota=True,user_id='626a43bd39a24fc192843bebe5e731eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983842e7-22d7-4132-b091-19fd843171d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983842e7-22d7-4132-b091-19fd843171d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe431a82-ee5c-4ded-b01d-76e0e889dcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe431a82-ee5c-4ded-b01d-76e0e889dcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f57c94a-75ea-4bea-9580-95104118fe3f', 'volume_name': 'volume-5f57c94a-75ea-4bea-9580-95104118fe3f', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caeecd2f-3d42-4458-a1ed-c57c77fc5879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caeecd2f-3d42-4458-a1ed-c57c77fc5879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4969d543-e317-44cf-9266-c2653e79c545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:34 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] Volume 5f57c94a-75ea-4bea-9580-95104118fe3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f57c94a-75ea-4bea-9580-95104118fe3f', 'volume_size': 1} Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4a265381-9948-4ba4-9e3e-061390f273e0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "cinder-45495268-85ee-4d74-9817-8dc1fae4e303-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4a265381-9948-4ba4-9e3e-061390f273e0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "cinder-45495268-85ee-4d74-9817-8dc1fae4e303-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:34 devstack sudo[97818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-035447a2-cff4-47be-97b3-b978338c7039 Sep 01 08:22:34 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4a265381-9948-4ba4-9e3e-061390f273e0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "cinder-quobyte-45495268-85ee-4d74-9817-8dc1fae4e303" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4a265381-9948-4ba4-9e3e-061390f273e0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "cinder-quobyte-45495268-85ee-4d74-9817-8dc1fae4e303" acquired by "delete_volume" :: waited 0.021s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ae5f05-ae03-4480-9d39-26f022a7f1f4]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4a265381-9948-4ba4-9e3e-061390f273e0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45495268-85ee-4d74-9817-8dc1fae4e303 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:34 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b2f83ee1-823f-48ea-a33a-ae54bc77f616 1073741824" returned: 0 in 0.770s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:34 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45495268-85ee-4d74-9817-8dc1fae4e303 Sep 01 08:22:34 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b2f83ee1-823f-48ea-a33a-ae54bc77f616 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:34 devstack sudo[97829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b2f83ee1-823f-48ea-a33a-ae54bc77f616 Sep 01 08:22:34 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:34 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ed1c8337-b17a-49e3-94fc-e603c829f44d tempest-AttachVolumeNegativeTest-1390424861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-035447a2-cff4-47be-97b3-b978338c7039" returned: 0 in 0.768s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ed1c8337-b17a-49e3-94fc-e603c829f44d tempest-AttachVolumeNegativeTest-1390424861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-035447a2-cff4-47be-97b3-b978338c7039 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:34 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-035447a2-cff4-47be-97b3-b978338c7039 Sep 01 08:22:34 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] Flow 'volume_create_manager' (ec79f6b6-4d9e-4830-bb7e-ca39fa7f9d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed6f482-1e43-4d81-9b4c-fda181167775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed6f482-1e43-4d81-9b4c-fda181167775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-81552081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b85ecb3d-89e8-4da7-88a3-2f99fd480ca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60286168a884a549a8f6a3bba3e078e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:35Z,use_quota=True,user_id='626a43bd39a24fc192843bebe5e731eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:34 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872754ed-3299-4bdb-ac94-a1f5c24ad57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872754ed-3299-4bdb-ac94-a1f5c24ad57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:34 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee360ba-6334-4287-b55c-7afcc2c6a12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee360ba-6334-4287-b55c-7afcc2c6a12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b85ecb3d-89e8-4da7-88a3-2f99fd480ca4', 'volume_name': 'volume-b85ecb3d-89e8-4da7-88a3-2f99fd480ca4', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d31f320-6320-489e-9105-d410f804cadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d31f320-6320-489e-9105-d410f804cadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e61118-3afa-47e2-849a-e9538799f7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:35 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] Volume b85ecb3d-89e8-4da7-88a3-2f99fd480ca4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b85ecb3d-89e8-4da7-88a3-2f99fd480ca4', 'volume_size': 1} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b2f83ee1-823f-48ea-a33a-ae54bc77f616" returned: 0 in 0.466s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4a265381-9948-4ba4-9e3e-061390f273e0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45495268-85ee-4d74-9817-8dc1fae4e303" returned: 0 in 0.677s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4a265381-9948-4ba4-9e3e-061390f273e0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45495268-85ee-4d74-9817-8dc1fae4e303 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.387s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1233995866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5722d8-7ec7-492c-8d30-4e95eb15cddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60286168a884a549a8f6a3bba3e078e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:33Z,use_quota=True,user_id='626a43bd39a24fc192843bebe5e731eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] Creating volume 3a5722d8-7ec7-492c-8d30-4e95eb15cddc {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:22:35 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3a5722d8-7ec7-492c-8d30-4e95eb15cddc 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:35 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45495268-85ee-4d74-9817-8dc1fae4e303 Sep 01 08:22:35 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b2cd569-2fc1-4b0b-a48f-63c0fea286e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2f83ee1-823f-48ea-a33a-ae54bc77f616', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:35 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5adaaffb-fc87-4353-bc3c-7a26c56f27a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:35 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3a5722d8-7ec7-492c-8d30-4e95eb15cddc 1073741824 Sep 01 08:22:35 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ed1c8337-b17a-49e3-94fc-e603c829f44d tempest-AttachVolumeNegativeTest-1390424861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-035447a2-cff4-47be-97b3-b978338c7039" returned: 0 in 0.386s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:35 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] Volume volume-b2f83ee1-823f-48ea-a33a-ae54bc77f616 (b2f83ee1-823f-48ea-a33a-ae54bc77f616): created successfully Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5adaaffb-fc87-4353-bc3c-7a26c56f27a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] Flow 'volume_create_manager' (f7175362-bb6c-4445-8ad8-e73168d444a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ed1c8337-b17a-49e3-94fc-e603c829f44d tempest-AttachVolumeNegativeTest-1390424861 None] Lock "cinder-quobyte-035447a2-cff4-47be-97b3-b978338c7039" released by "delete_volume" :: held 1.280s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:35 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-5636878c-0e9b-4a5d-ae22-00a3c7c5b4b1 tempest-CreateVolumesFromImageTest-597456346 None] Created volume successfully. Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-ed1c8337-b17a-49e3-94fc-e603c829f44d tempest-AttachVolumeNegativeTest-1390424861 None] Created reservations ['53bd7fd8-dd55-41c9-98cb-8b6ab1e1c63f', 'e9d81b86-6aae-41ec-aadf-10ce4296c18f', '154ab25c-011c-4743-b85d-18757c8fb530', '29dbe166-60fb-4ac4-a99e-fab814c541be'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ed1c8337-b17a-49e3-94fc-e603c829f44d tempest-AttachVolumeNegativeTest-1390424861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ed1c8337-b17a-49e3-94fc-e603c829f44d tempest-AttachVolumeNegativeTest-1390424861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ed1c8337-b17a-49e3-94fc-e603c829f44d tempest-AttachVolumeNegativeTest-1390424861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ed1c8337-b17a-49e3-94fc-e603c829f44d tempest-AttachVolumeNegativeTest-1390424861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ed1c8337-b17a-49e3-94fc-e603c829f44d tempest-AttachVolumeNegativeTest-1390424861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ed1c8337-b17a-49e3-94fc-e603c829f44d tempest-AttachVolumeNegativeTest-1390424861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:35 devstack sudo[97845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:22:35 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:35 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4a265381-9948-4ba4-9e3e-061390f273e0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45495268-85ee-4d74-9817-8dc1fae4e303" returned: 0 in 0.389s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4a265381-9948-4ba4-9e3e-061390f273e0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "cinder-quobyte-45495268-85ee-4d74-9817-8dc1fae4e303" released by "delete_volume" :: held 1.136s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-4a265381-9948-4ba4-9e3e-061390f273e0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Created reservations ['8997a608-c46e-44bf-a6d0-86af5a792f3f', '973ae7c0-c2a1-47fe-a282-174822690c42', 'e7dfa568-d126-4cbc-b2ae-30fbe32d715e', 'df0ec318-3add-47ac-9ee8-f10e4594277f'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4a265381-9948-4ba4-9e3e-061390f273e0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:35 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4a265381-9948-4ba4-9e3e-061390f273e0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4a265381-9948-4ba4-9e3e-061390f273e0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4a265381-9948-4ba4-9e3e-061390f273e0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4a265381-9948-4ba4-9e3e-061390f273e0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4a265381-9948-4ba4-9e3e-061390f273e0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ed1c8337-b17a-49e3-94fc-e603c829f44d tempest-AttachVolumeNegativeTest-1390424861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.335s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-ed1c8337-b17a-49e3-94fc-e603c829f44d tempest-AttachVolumeNegativeTest-1390424861 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:22:35 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-ed1c8337-b17a-49e3-94fc-e603c829f44d tempest-AttachVolumeNegativeTest-1390424861 None] Deleted volume successfully. Sep 01 08:22:35 devstack sudo[97853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:22:35 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ed1c8337-b17a-49e3-94fc-e603c829f44d tempest-AttachVolumeNegativeTest-1390424861 None] Lock "cinder-035447a2-cff4-47be-97b3-b978338c7039-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:35 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3a5722d8-7ec7-492c-8d30-4e95eb15cddc 1073741824" returned: 0 in 0.679s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3a5722d8-7ec7-492c-8d30-4e95eb15cddc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:35 devstack sudo[97855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3a5722d8-7ec7-492c-8d30-4e95eb15cddc Sep 01 08:22:35 devstack sudo[97855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:36 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4a265381-9948-4ba4-9e3e-061390f273e0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.422s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-4a265381-9948-4ba4-9e3e-061390f273e0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:22:36 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-4a265381-9948-4ba4-9e3e-061390f273e0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Deleted volume successfully. Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4a265381-9948-4ba4-9e3e-061390f273e0 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "cinder-45495268-85ee-4d74-9817-8dc1fae4e303-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:36 devstack sudo[97855]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3a5722d8-7ec7-492c-8d30-4e95eb15cddc" returned: 0 in 0.362s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1434708045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f57c94a-75ea-4bea-9580-95104118fe3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60286168a884a549a8f6a3bba3e078e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:34Z,use_quota=True,user_id='626a43bd39a24fc192843bebe5e731eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] Creating volume 5f57c94a-75ea-4bea-9580-95104118fe3f {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:22:36 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5f57c94a-75ea-4bea-9580-95104118fe3f 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e070a058-fd2c-4309-bf09-2dd3fe5c13b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a5722d8-7ec7-492c-8d30-4e95eb15cddc', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:36 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5f57c94a-75ea-4bea-9580-95104118fe3f 1073741824 Sep 01 08:22:36 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d2a003-a43e-4bc2-bb1a-602898421fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:36 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] Volume volume-3a5722d8-7ec7-492c-8d30-4e95eb15cddc (3a5722d8-7ec7-492c-8d30-4e95eb15cddc): created successfully Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d2a003-a43e-4bc2-bb1a-602898421fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] Flow 'volume_create_manager' (ad5b589a-c6c9-4fbd-841c-d7ea80f5e89d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:36 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-2e919018-781e-479d-b08b-d608f8b9d15f tempest-CreateVolumesFromImageTest-597456346 None] Created volume successfully. Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a0a2cfbd-5ea6-49d3-9616-e1372947f6d1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "cinder-d18df74a-79f5-4009-8fa8-4970534fb6a2-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a0a2cfbd-5ea6-49d3-9616-e1372947f6d1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "cinder-d18df74a-79f5-4009-8fa8-4970534fb6a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a0a2cfbd-5ea6-49d3-9616-e1372947f6d1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "cinder-quobyte-fcf88953-7ae1-48ae-997c-3077c60e2252" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a0a2cfbd-5ea6-49d3-9616-e1372947f6d1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "cinder-quobyte-fcf88953-7ae1-48ae-997c-3077c60e2252" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a0a2cfbd-5ea6-49d3-9616-e1372947f6d1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "cinder-quobyte-d18df74a-79f5-4009-8fa8-4970534fb6a2" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a0a2cfbd-5ea6-49d3-9616-e1372947f6d1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "cinder-quobyte-d18df74a-79f5-4009-8fa8-4970534fb6a2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-a0a2cfbd-5ea6-49d3-9616-e1372947f6d1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Deleting offline snapshot d18df74a-79f5-4009-8fa8-4970534fb6a2 of volume fcf88953-7ae1-48ae-997c-3077c60e2252 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-a0a2cfbd-5ea6-49d3-9616-e1372947f6d1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] snapshot_file for this snap is: volume-fcf88953-7ae1-48ae-997c-3077c60e2252.d18df74a-79f5-4009-8fa8-4970534fb6a2 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0d28b4-6c42-437a-afd2-2cb240c99b8e]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a0a2cfbd-5ea6-49d3-9616-e1372947f6d1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252.d18df74a-79f5-4009-8fa8-4970534fb6a2 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:36 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5f57c94a-75ea-4bea-9580-95104118fe3f 1073741824" returned: 0 in 0.465s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5f57c94a-75ea-4bea-9580-95104118fe3f {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:36 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252.d18df74a-79f5-4009-8fa8-4970534fb6a2 Sep 01 08:22:36 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:36 devstack sudo[97867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5f57c94a-75ea-4bea-9580-95104118fe3f Sep 01 08:22:36 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:36 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5f57c94a-75ea-4bea-9580-95104118fe3f" returned: 0 in 0.269s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.942s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-81552081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b85ecb3d-89e8-4da7-88a3-2f99fd480ca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60286168a884a549a8f6a3bba3e078e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:35Z,use_quota=True,user_id='626a43bd39a24fc192843bebe5e731eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] Creating volume b85ecb3d-89e8-4da7-88a3-2f99fd480ca4 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:22:36 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:22:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b85ecb3d-89e8-4da7-88a3-2f99fd480ca4 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:36 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4969d543-e317-44cf-9266-c2653e79c545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f57c94a-75ea-4bea-9580-95104118fe3f', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:37 devstack sudo[97873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b85ecb3d-89e8-4da7-88a3-2f99fd480ca4 1073741824 Sep 01 08:22:37 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d331d0f1-602f-4f82-9d5b-f966d2268b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a0a2cfbd-5ea6-49d3-9616-e1372947f6d1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252.d18df74a-79f5-4009-8fa8-4970534fb6a2" returned: 0 in 0.461s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-a0a2cfbd-5ea6-49d3-9616-e1372947f6d1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcf88953-7ae1-48ae-997c-3077c60e2252(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:22:37 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] Volume volume-5f57c94a-75ea-4bea-9580-95104118fe3f (5f57c94a-75ea-4bea-9580-95104118fe3f): created successfully Sep 01 08:22:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d331d0f1-602f-4f82-9d5b-f966d2268b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] Flow 'volume_create_manager' (1142eb8e-4fc3-4de9-8e88-54a3360a625a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:37 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2667de-d862-4a11-b7c9-7c2b571e29ba]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:22:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a0a2cfbd-5ea6-49d3-9616-e1372947f6d1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:37 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-fbbdcac3-bacd-4e7e-949c-1e3de4815a1f tempest-CreateVolumesFromImageTest-597456346 None] Created volume successfully. Sep 01 08:22:37 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252 Sep 01 08:22:37 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:37 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a0a2cfbd-5ea6-49d3-9616-e1372947f6d1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252" returned: 0 in 0.456s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a0a2cfbd-5ea6-49d3-9616-e1372947f6d1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252.d18df74a-79f5-4009-8fa8-4970534fb6a2 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:37 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b85ecb3d-89e8-4da7-88a3-2f99fd480ca4 1073741824" returned: 0 in 0.600s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:37 devstack sudo[97885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252.d18df74a-79f5-4009-8fa8-4970534fb6a2 Sep 01 08:22:37 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b85ecb3d-89e8-4da7-88a3-2f99fd480ca4 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:37 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b85ecb3d-89e8-4da7-88a3-2f99fd480ca4 Sep 01 08:22:37 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:37 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b85ecb3d-89e8-4da7-88a3-2f99fd480ca4" returned: 0 in 0.358s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:22:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e61118-3afa-47e2-849a-e9538799f7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b85ecb3d-89e8-4da7-88a3-2f99fd480ca4', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9da2477-efbe-4fd5-9587-24f3c90d8197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:38 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] Volume volume-b85ecb3d-89e8-4da7-88a3-2f99fd480ca4 (b85ecb3d-89e8-4da7-88a3-2f99fd480ca4): created successfully Sep 01 08:22:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9da2477-efbe-4fd5-9587-24f3c90d8197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] Flow 'volume_create_manager' (ec79f6b6-4d9e-4830-bb7e-ca39fa7f9d52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:38 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-1b563600-ab0f-4191-b8f2-241e760c9a55 tempest-CreateVolumesFromImageTest-597456346 None] Created volume successfully. Sep 01 08:22:38 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a0a2cfbd-5ea6-49d3-9616-e1372947f6d1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252.d18df74a-79f5-4009-8fa8-4970534fb6a2" returned: 0 in 0.532s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a0a2cfbd-5ea6-49d3-9616-e1372947f6d1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252.d18df74a-79f5-4009-8fa8-4970534fb6a2 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:38 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252.d18df74a-79f5-4009-8fa8-4970534fb6a2 Sep 01 08:22:38 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:38 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-5d47bc35-6275-4a9f-8bc6-097586443f60 tempest-AttachVolumeTestJSON-1416367693 None] Acquiring lock "cinder-41bc5533-140b-4884-bb66-c5be7f6f8567-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:38 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-5d47bc35-6275-4a9f-8bc6-097586443f60 tempest-AttachVolumeTestJSON-1416367693 None] Lock "cinder-41bc5533-140b-4884-bb66-c5be7f6f8567-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:38 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-5d47bc35-6275-4a9f-8bc6-097586443f60 tempest-AttachVolumeTestJSON-1416367693 None] Acquiring lock "cinder-quobyte-41bc5533-140b-4884-bb66-c5be7f6f8567" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:38 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-5d47bc35-6275-4a9f-8bc6-097586443f60 tempest-AttachVolumeTestJSON-1416367693 None] Lock "cinder-quobyte-41bc5533-140b-4884-bb66-c5be7f6f8567" acquired by "delete_volume" :: waited 0.024s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:38 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:38 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-fe5dd916-1fac-4836-ac24-a35766d8cf87 tempest-CreateVolumesFromImageTest-597456346 None] Acquiring lock "cinder-b85ecb3d-89e8-4da7-88a3-2f99fd480ca4-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a0a2cfbd-5ea6-49d3-9616-e1372947f6d1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252.d18df74a-79f5-4009-8fa8-4970534fb6a2" returned: 0 in 0.352s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:38 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d804be2-7a09-4dbe-88ea-493c6a0527aa]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:22:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d47bc35-6275-4a9f-8bc6-097586443f60 tempest-AttachVolumeTestJSON-1416367693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-41bc5533-140b-4884-bb66-c5be7f6f8567 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:38 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-fe5dd916-1fac-4836-ac24-a35766d8cf87 tempest-CreateVolumesFromImageTest-597456346 None] Lock "cinder-b85ecb3d-89e8-4da7-88a3-2f99fd480ca4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:38 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a0a2cfbd-5ea6-49d3-9616-e1372947f6d1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "cinder-quobyte-d18df74a-79f5-4009-8fa8-4970534fb6a2" released by "_delete_snapshot" :: held 1.981s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:38 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a0a2cfbd-5ea6-49d3-9616-e1372947f6d1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "cinder-quobyte-fcf88953-7ae1-48ae-997c-3077c60e2252" released by "delete_snapshot" :: held 2.016s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:38 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-fe5dd916-1fac-4836-ac24-a35766d8cf87 tempest-CreateVolumesFromImageTest-597456346 None] Acquiring lock "cinder-quobyte-b85ecb3d-89e8-4da7-88a3-2f99fd480ca4" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:38 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-fe5dd916-1fac-4836-ac24-a35766d8cf87 tempest-CreateVolumesFromImageTest-597456346 None] Lock "cinder-quobyte-b85ecb3d-89e8-4da7-88a3-2f99fd480ca4" acquired by "delete_volume" :: waited 0.031s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:38 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-41bc5533-140b-4884-bb66-c5be7f6f8567 Sep 01 08:22:38 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:38 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a6add9-dda1-414d-a171-177c84f9b8e3]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:22:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fe5dd916-1fac-4836-ac24-a35766d8cf87 tempest-CreateVolumesFromImageTest-597456346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b85ecb3d-89e8-4da7-88a3-2f99fd480ca4 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:38 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-a0a2cfbd-5ea6-49d3-9616-e1372947f6d1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Created reservations ['0e687768-69f1-4969-bf71-defec97c97c6', '97001a77-8f82-4e8d-8b24-82ddaf4a7d8d', '819b1199-63b6-43e4-a9ad-1a5653c2faea', '2eb62651-9380-4a6f-9c37-0fb8e1c44d6c'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:22:38 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-a0a2cfbd-5ea6-49d3-9616-e1372947f6d1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Delete snapshot completed successfully. Sep 01 08:22:38 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b85ecb3d-89e8-4da7-88a3-2f99fd480ca4 Sep 01 08:22:38 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:38 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a0a2cfbd-5ea6-49d3-9616-e1372947f6d1 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "cinder-d18df74a-79f5-4009-8fa8-4970534fb6a2-delete_snapshot" released by "delete_snapshot" :: held 2.311s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:38 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d47bc35-6275-4a9f-8bc6-097586443f60 tempest-AttachVolumeTestJSON-1416367693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-41bc5533-140b-4884-bb66-c5be7f6f8567" returned: 0 in 0.471s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d47bc35-6275-4a9f-8bc6-097586443f60 tempest-AttachVolumeTestJSON-1416367693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-41bc5533-140b-4884-bb66-c5be7f6f8567 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:38 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-41bc5533-140b-4884-bb66-c5be7f6f8567 Sep 01 08:22:38 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:39 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fe5dd916-1fac-4836-ac24-a35766d8cf87 tempest-CreateVolumesFromImageTest-597456346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b85ecb3d-89e8-4da7-88a3-2f99fd480ca4" returned: 0 in 0.431s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fe5dd916-1fac-4836-ac24-a35766d8cf87 tempest-CreateVolumesFromImageTest-597456346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b85ecb3d-89e8-4da7-88a3-2f99fd480ca4 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:39 devstack sudo[97909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b85ecb3d-89e8-4da7-88a3-2f99fd480ca4 Sep 01 08:22:39 devstack sudo[97909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:39 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d47bc35-6275-4a9f-8bc6-097586443f60 tempest-AttachVolumeTestJSON-1416367693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-41bc5533-140b-4884-bb66-c5be7f6f8567" returned: 0 in 0.271s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-5d47bc35-6275-4a9f-8bc6-097586443f60 tempest-AttachVolumeTestJSON-1416367693 None] Lock "cinder-quobyte-41bc5533-140b-4884-bb66-c5be7f6f8567" released by "delete_volume" :: held 0.809s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-5d47bc35-6275-4a9f-8bc6-097586443f60 tempest-AttachVolumeTestJSON-1416367693 None] Created reservations ['83877a2f-434e-424e-9a45-94b4a03b2cf4', '4f20a542-9264-4070-8978-e7084bbca86e', '5cfd130e-9f93-4ff5-a63d-214b96d20c62', 'ebf99822-616a-425c-b8ac-f738a9390595'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5d47bc35-6275-4a9f-8bc6-097586443f60 tempest-AttachVolumeTestJSON-1416367693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5d47bc35-6275-4a9f-8bc6-097586443f60 tempest-AttachVolumeTestJSON-1416367693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-5d47bc35-6275-4a9f-8bc6-097586443f60 tempest-AttachVolumeTestJSON-1416367693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:39 devstack sudo[97909]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-5d47bc35-6275-4a9f-8bc6-097586443f60 tempest-AttachVolumeTestJSON-1416367693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5d47bc35-6275-4a9f-8bc6-097586443f60 tempest-AttachVolumeTestJSON-1416367693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d47bc35-6275-4a9f-8bc6-097586443f60 tempest-AttachVolumeTestJSON-1416367693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fe5dd916-1fac-4836-ac24-a35766d8cf87 tempest-CreateVolumesFromImageTest-597456346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b85ecb3d-89e8-4da7-88a3-2f99fd480ca4" returned: 0 in 0.289s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:39 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:22:39 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-fe5dd916-1fac-4836-ac24-a35766d8cf87 tempest-CreateVolumesFromImageTest-597456346 None] Lock "cinder-quobyte-b85ecb3d-89e8-4da7-88a3-2f99fd480ca4" released by "delete_volume" :: held 0.784s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-fe5dd916-1fac-4836-ac24-a35766d8cf87 tempest-CreateVolumesFromImageTest-597456346 None] Created reservations ['b0f130cc-7aaf-4750-98b6-97e8e8fe5c5d', '9b03e6c0-7275-40e9-b339-ad26e914e538', '3cf5e296-61d8-4792-ab4f-1fe172bc192c', '17f21435-fcf9-4300-8ae6-264041fd30f8'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-fe5dd916-1fac-4836-ac24-a35766d8cf87 tempest-CreateVolumesFromImageTest-597456346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-fe5dd916-1fac-4836-ac24-a35766d8cf87 tempest-CreateVolumesFromImageTest-597456346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-fe5dd916-1fac-4836-ac24-a35766d8cf87 tempest-CreateVolumesFromImageTest-597456346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-fe5dd916-1fac-4836-ac24-a35766d8cf87 tempest-CreateVolumesFromImageTest-597456346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-fe5dd916-1fac-4836-ac24-a35766d8cf87 tempest-CreateVolumesFromImageTest-597456346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fe5dd916-1fac-4836-ac24-a35766d8cf87 tempest-CreateVolumesFromImageTest-597456346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:39 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:22:39 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d08c15eb-b0c0-4157-ae87-efc1995484bc tempest-AttachVolumeTestJSON-1416367693 None] Acquiring lock "cinder-ad3e5ff8-1442-49ce-a676-bcff22403e65-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d08c15eb-b0c0-4157-ae87-efc1995484bc tempest-AttachVolumeTestJSON-1416367693 None] Lock "cinder-ad3e5ff8-1442-49ce-a676-bcff22403e65-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-35a71ee8-438c-494a-ac76-8e25e76e5b0e tempest-CreateVolumesFromImageTest-597456346 None] Acquiring lock "cinder-5f57c94a-75ea-4bea-9580-95104118fe3f-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-35a71ee8-438c-494a-ac76-8e25e76e5b0e tempest-CreateVolumesFromImageTest-597456346 None] Lock "cinder-5f57c94a-75ea-4bea-9580-95104118fe3f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:39 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d47bc35-6275-4a9f-8bc6-097586443f60 tempest-AttachVolumeTestJSON-1416367693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.396s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-5d47bc35-6275-4a9f-8bc6-097586443f60 tempest-AttachVolumeTestJSON-1416367693 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d08c15eb-b0c0-4157-ae87-efc1995484bc tempest-AttachVolumeTestJSON-1416367693 None] Acquiring lock "cinder-quobyte-ad3e5ff8-1442-49ce-a676-bcff22403e65" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:39 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-5d47bc35-6275-4a9f-8bc6-097586443f60 tempest-AttachVolumeTestJSON-1416367693 None] Deleted volume successfully. Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-c632311e-390e-48f4-85ff-8f95996eaa14 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "cinder-fcf88953-7ae1-48ae-997c-3077c60e2252-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d08c15eb-b0c0-4157-ae87-efc1995484bc tempest-AttachVolumeTestJSON-1416367693 None] Lock "cinder-quobyte-ad3e5ff8-1442-49ce-a676-bcff22403e65" acquired by "delete_volume" :: waited 0.065s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-5d47bc35-6275-4a9f-8bc6-097586443f60 tempest-AttachVolumeTestJSON-1416367693 None] Lock "cinder-41bc5533-140b-4884-bb66-c5be7f6f8567-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-c632311e-390e-48f4-85ff-8f95996eaa14 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "cinder-fcf88953-7ae1-48ae-997c-3077c60e2252-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-35a71ee8-438c-494a-ac76-8e25e76e5b0e tempest-CreateVolumesFromImageTest-597456346 None] Acquiring lock "cinder-quobyte-5f57c94a-75ea-4bea-9580-95104118fe3f" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[e959e2e8-ea81-4293-bde6-fd22fc634a50]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d08c15eb-b0c0-4157-ae87-efc1995484bc tempest-AttachVolumeTestJSON-1416367693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ad3e5ff8-1442-49ce-a676-bcff22403e65 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-35a71ee8-438c-494a-ac76-8e25e76e5b0e tempest-CreateVolumesFromImageTest-597456346 None] Lock "cinder-quobyte-5f57c94a-75ea-4bea-9580-95104118fe3f" acquired by "delete_volume" :: waited 0.069s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-c632311e-390e-48f4-85ff-8f95996eaa14 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "cinder-quobyte-fcf88953-7ae1-48ae-997c-3077c60e2252" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[21864fb3-4b76-4b28-92b1-87603361b722]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-35a71ee8-438c-494a-ac76-8e25e76e5b0e tempest-CreateVolumesFromImageTest-597456346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5f57c94a-75ea-4bea-9580-95104118fe3f {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:39 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fe5dd916-1fac-4836-ac24-a35766d8cf87 tempest-CreateVolumesFromImageTest-597456346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.475s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:39 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-fe5dd916-1fac-4836-ac24-a35766d8cf87 tempest-CreateVolumesFromImageTest-597456346 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:22:40 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-fe5dd916-1fac-4836-ac24-a35766d8cf87 tempest-CreateVolumesFromImageTest-597456346 None] Deleted volume successfully. Sep 01 08:22:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-c632311e-390e-48f4-85ff-8f95996eaa14 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "cinder-quobyte-fcf88953-7ae1-48ae-997c-3077c60e2252" acquired by "delete_volume" :: waited 0.051s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:40 devstack sudo[97918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ad3e5ff8-1442-49ce-a676-bcff22403e65 Sep 01 08:22:40 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:40 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5b3a27-513c-4b09-86ef-efea8d2a909e]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:22:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-fe5dd916-1fac-4836-ac24-a35766d8cf87 tempest-CreateVolumesFromImageTest-597456346 None] Lock "cinder-b85ecb3d-89e8-4da7-88a3-2f99fd480ca4-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c632311e-390e-48f4-85ff-8f95996eaa14 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:40 devstack sudo[97920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5f57c94a-75ea-4bea-9580-95104118fe3f Sep 01 08:22:40 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:40 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252 Sep 01 08:22:40 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:40 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d08c15eb-b0c0-4157-ae87-efc1995484bc tempest-AttachVolumeTestJSON-1416367693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ad3e5ff8-1442-49ce-a676-bcff22403e65" returned: 0 in 0.454s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d08c15eb-b0c0-4157-ae87-efc1995484bc tempest-AttachVolumeTestJSON-1416367693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ad3e5ff8-1442-49ce-a676-bcff22403e65 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:40 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ad3e5ff8-1442-49ce-a676-bcff22403e65 Sep 01 08:22:40 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:40 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-35a71ee8-438c-494a-ac76-8e25e76e5b0e tempest-CreateVolumesFromImageTest-597456346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5f57c94a-75ea-4bea-9580-95104118fe3f" returned: 0 in 0.409s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-35a71ee8-438c-494a-ac76-8e25e76e5b0e tempest-CreateVolumesFromImageTest-597456346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5f57c94a-75ea-4bea-9580-95104118fe3f {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:40 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5f57c94a-75ea-4bea-9580-95104118fe3f Sep 01 08:22:40 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:40 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c632311e-390e-48f4-85ff-8f95996eaa14 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252" returned: 0 in 0.424s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c632311e-390e-48f4-85ff-8f95996eaa14 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:40 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252 Sep 01 08:22:40 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:40 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d08c15eb-b0c0-4157-ae87-efc1995484bc tempest-AttachVolumeTestJSON-1416367693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ad3e5ff8-1442-49ce-a676-bcff22403e65" returned: 0 in 0.264s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d08c15eb-b0c0-4157-ae87-efc1995484bc tempest-AttachVolumeTestJSON-1416367693 None] Lock "cinder-quobyte-ad3e5ff8-1442-49ce-a676-bcff22403e65" released by "delete_volume" :: held 0.770s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:40 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-35a71ee8-438c-494a-ac76-8e25e76e5b0e tempest-CreateVolumesFromImageTest-597456346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-5f57c94a-75ea-4bea-9580-95104118fe3f" returned: 0 in 0.281s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:40 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-d08c15eb-b0c0-4157-ae87-efc1995484bc tempest-AttachVolumeTestJSON-1416367693 None] Created reservations ['785d0a0d-41ad-4354-abb1-34e0660c88e8', 'e2327e0b-7b11-4309-8f05-2d6f8a1aab94', '496a2748-4cce-4a50-a9ad-fcb72c03b994', '4f716820-703c-46ad-a284-33fa11846627'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:22:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-35a71ee8-438c-494a-ac76-8e25e76e5b0e tempest-CreateVolumesFromImageTest-597456346 None] Lock "cinder-quobyte-5f57c94a-75ea-4bea-9580-95104118fe3f" released by "delete_volume" :: held 0.772s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:40 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c632311e-390e-48f4-85ff-8f95996eaa14 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fcf88953-7ae1-48ae-997c-3077c60e2252" returned: 0 in 0.288s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d08c15eb-b0c0-4157-ae87-efc1995484bc tempest-AttachVolumeTestJSON-1416367693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d08c15eb-b0c0-4157-ae87-efc1995484bc tempest-AttachVolumeTestJSON-1416367693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:40 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d08c15eb-b0c0-4157-ae87-efc1995484bc tempest-AttachVolumeTestJSON-1416367693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:40 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d08c15eb-b0c0-4157-ae87-efc1995484bc tempest-AttachVolumeTestJSON-1416367693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d08c15eb-b0c0-4157-ae87-efc1995484bc tempest-AttachVolumeTestJSON-1416367693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d08c15eb-b0c0-4157-ae87-efc1995484bc tempest-AttachVolumeTestJSON-1416367693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-c632311e-390e-48f4-85ff-8f95996eaa14 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "cinder-quobyte-fcf88953-7ae1-48ae-997c-3077c60e2252" released by "delete_volume" :: held 0.815s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:40 devstack sudo[97944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:22:40 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:40 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-35a71ee8-438c-494a-ac76-8e25e76e5b0e tempest-CreateVolumesFromImageTest-597456346 None] Created reservations ['914fa146-e4e8-423a-b494-343a4df0a355', '415f66ea-66d1-4023-a3e7-c3f70d121574', 'b59d63e0-465f-4f8a-8a9a-b78eeb958e74', 'ce0aad09-324f-47b4-8365-49b539a0d103'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:22:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-35a71ee8-438c-494a-ac76-8e25e76e5b0e tempest-CreateVolumesFromImageTest-597456346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-35a71ee8-438c-494a-ac76-8e25e76e5b0e tempest-CreateVolumesFromImageTest-597456346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:40 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-35a71ee8-438c-494a-ac76-8e25e76e5b0e tempest-CreateVolumesFromImageTest-597456346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:40 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-35a71ee8-438c-494a-ac76-8e25e76e5b0e tempest-CreateVolumesFromImageTest-597456346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-35a71ee8-438c-494a-ac76-8e25e76e5b0e tempest-CreateVolumesFromImageTest-597456346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-35a71ee8-438c-494a-ac76-8e25e76e5b0e tempest-CreateVolumesFromImageTest-597456346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:41 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-c632311e-390e-48f4-85ff-8f95996eaa14 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Created reservations ['79b97409-78c5-4f3d-b575-ba2b35019372', 'e7a83e58-eea9-4151-97c9-b08f41e82ddd', 'af9ef5fa-67c6-460b-b0bc-3bf43793c17a', '46a9631e-b8da-40e1-853d-a23502f6d341'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:22:41 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:22:41 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:41 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-70fdfe3c-e560-4880-8b2c-a5d275fb0503 tempest-AttachVolumeTestJSON-1416367693 None] Acquiring lock "cinder-b907e99e-4fc7-40e7-a6d1-b64abcacc2ee-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:41 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-70fdfe3c-e560-4880-8b2c-a5d275fb0503 tempest-AttachVolumeTestJSON-1416367693 None] Lock "cinder-b907e99e-4fc7-40e7-a6d1-b64abcacc2ee-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:41 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:41 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-70fdfe3c-e560-4880-8b2c-a5d275fb0503 tempest-AttachVolumeTestJSON-1416367693 None] Acquiring lock "cinder-quobyte-b907e99e-4fc7-40e7-a6d1-b64abcacc2ee" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d08c15eb-b0c0-4157-ae87-efc1995484bc tempest-AttachVolumeTestJSON-1416367693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.415s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:41 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-d08c15eb-b0c0-4157-ae87-efc1995484bc tempest-AttachVolumeTestJSON-1416367693 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:22:41 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-d08c15eb-b0c0-4157-ae87-efc1995484bc tempest-AttachVolumeTestJSON-1416367693 None] Deleted volume successfully. Sep 01 08:22:41 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-70fdfe3c-e560-4880-8b2c-a5d275fb0503 tempest-AttachVolumeTestJSON-1416367693 None] Lock "cinder-quobyte-b907e99e-4fc7-40e7-a6d1-b64abcacc2ee" acquired by "delete_volume" :: waited 0.032s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c632311e-390e-48f4-85ff-8f95996eaa14 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c632311e-390e-48f4-85ff-8f95996eaa14 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:41 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c632311e-390e-48f4-85ff-8f95996eaa14 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:41 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c632311e-390e-48f4-85ff-8f95996eaa14 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c632311e-390e-48f4-85ff-8f95996eaa14 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c632311e-390e-48f4-85ff-8f95996eaa14 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:41 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[7919a59e-bf5f-4c0b-a537-c9cba47bf776]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:22:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-70fdfe3c-e560-4880-8b2c-a5d275fb0503 tempest-AttachVolumeTestJSON-1416367693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b907e99e-4fc7-40e7-a6d1-b64abcacc2ee {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:41 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:22:41 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:41 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d08c15eb-b0c0-4157-ae87-efc1995484bc tempest-AttachVolumeTestJSON-1416367693 None] Lock "cinder-ad3e5ff8-1442-49ce-a676-bcff22403e65-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:41 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-35a71ee8-438c-494a-ac76-8e25e76e5b0e tempest-CreateVolumesFromImageTest-597456346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.440s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:41 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-35a71ee8-438c-494a-ac76-8e25e76e5b0e tempest-CreateVolumesFromImageTest-597456346 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:22:41 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-35a71ee8-438c-494a-ac76-8e25e76e5b0e tempest-CreateVolumesFromImageTest-597456346 None] Deleted volume successfully. Sep 01 08:22:41 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-35a71ee8-438c-494a-ac76-8e25e76e5b0e tempest-CreateVolumesFromImageTest-597456346 None] Lock "cinder-5f57c94a-75ea-4bea-9580-95104118fe3f-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:41 devstack sudo[97950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b907e99e-4fc7-40e7-a6d1-b64abcacc2ee Sep 01 08:22:41 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:41 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c632311e-390e-48f4-85ff-8f95996eaa14 tempest-CreateVolumesFromSnapshotTest-1966592782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.289s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:41 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-c632311e-390e-48f4-85ff-8f95996eaa14 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:22:41 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-c632311e-390e-48f4-85ff-8f95996eaa14 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Deleted volume successfully. Sep 01 08:22:41 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-c632311e-390e-48f4-85ff-8f95996eaa14 tempest-CreateVolumesFromSnapshotTest-1966592782 None] Lock "cinder-fcf88953-7ae1-48ae-997c-3077c60e2252-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:41 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-70fdfe3c-e560-4880-8b2c-a5d275fb0503 tempest-AttachVolumeTestJSON-1416367693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b907e99e-4fc7-40e7-a6d1-b64abcacc2ee" returned: 0 in 0.420s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-70fdfe3c-e560-4880-8b2c-a5d275fb0503 tempest-AttachVolumeTestJSON-1416367693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b907e99e-4fc7-40e7-a6d1-b64abcacc2ee {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:41 devstack sudo[97958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b907e99e-4fc7-40e7-a6d1-b64abcacc2ee Sep 01 08:22:41 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0e3b9b6d-86d1-4023-9abe-ad55d7d116f9 tempest-CreateVolumesFromImageTest-597456346 None] Acquiring lock "cinder-3a5722d8-7ec7-492c-8d30-4e95eb15cddc-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:42 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-70fdfe3c-e560-4880-8b2c-a5d275fb0503 tempest-AttachVolumeTestJSON-1416367693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b907e99e-4fc7-40e7-a6d1-b64abcacc2ee" returned: 0 in 0.282s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-70fdfe3c-e560-4880-8b2c-a5d275fb0503 tempest-AttachVolumeTestJSON-1416367693 None] Lock "cinder-quobyte-b907e99e-4fc7-40e7-a6d1-b64abcacc2ee" released by "delete_volume" :: held 0.776s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0e3b9b6d-86d1-4023-9abe-ad55d7d116f9 tempest-CreateVolumesFromImageTest-597456346 None] Lock "cinder-3a5722d8-7ec7-492c-8d30-4e95eb15cddc-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0e3b9b6d-86d1-4023-9abe-ad55d7d116f9 tempest-CreateVolumesFromImageTest-597456346 None] Acquiring lock "cinder-quobyte-3a5722d8-7ec7-492c-8d30-4e95eb15cddc" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:42 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-70fdfe3c-e560-4880-8b2c-a5d275fb0503 tempest-AttachVolumeTestJSON-1416367693 None] Created reservations ['6884f5bf-c8d9-4e5b-b822-025be2bf4556', '94130d13-eb45-4363-b3c9-1fabf40a818e', 'c0b1fc60-6bd0-4d47-93e8-76fc2438fe49', '6f44b2a2-b20d-4857-bfc7-c0a7873de27a'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:22:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0e3b9b6d-86d1-4023-9abe-ad55d7d116f9 tempest-CreateVolumesFromImageTest-597456346 None] Lock "cinder-quobyte-3a5722d8-7ec7-492c-8d30-4e95eb15cddc" acquired by "delete_volume" :: waited 0.034s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:42 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c88a04-9e57-429c-bc88-27a3c993f835]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:22:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0e3b9b6d-86d1-4023-9abe-ad55d7d116f9 tempest-CreateVolumesFromImageTest-597456346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3a5722d8-7ec7-492c-8d30-4e95eb15cddc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-70fdfe3c-e560-4880-8b2c-a5d275fb0503 tempest-AttachVolumeTestJSON-1416367693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-70fdfe3c-e560-4880-8b2c-a5d275fb0503 tempest-AttachVolumeTestJSON-1416367693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-70fdfe3c-e560-4880-8b2c-a5d275fb0503 tempest-AttachVolumeTestJSON-1416367693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-70fdfe3c-e560-4880-8b2c-a5d275fb0503 tempest-AttachVolumeTestJSON-1416367693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-70fdfe3c-e560-4880-8b2c-a5d275fb0503 tempest-AttachVolumeTestJSON-1416367693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-70fdfe3c-e560-4880-8b2c-a5d275fb0503 tempest-AttachVolumeTestJSON-1416367693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:42 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:22:42 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:42 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3a5722d8-7ec7-492c-8d30-4e95eb15cddc Sep 01 08:22:42 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:42 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-70fdfe3c-e560-4880-8b2c-a5d275fb0503 tempest-AttachVolumeTestJSON-1416367693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.363s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:42 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-70fdfe3c-e560-4880-8b2c-a5d275fb0503 tempest-AttachVolumeTestJSON-1416367693 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:22:42 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-70fdfe3c-e560-4880-8b2c-a5d275fb0503 tempest-AttachVolumeTestJSON-1416367693 None] Deleted volume successfully. Sep 01 08:22:42 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-70fdfe3c-e560-4880-8b2c-a5d275fb0503 tempest-AttachVolumeTestJSON-1416367693 None] Lock "cinder-b907e99e-4fc7-40e7-a6d1-b64abcacc2ee-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0e3b9b6d-86d1-4023-9abe-ad55d7d116f9 tempest-CreateVolumesFromImageTest-597456346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3a5722d8-7ec7-492c-8d30-4e95eb15cddc" returned: 0 in 0.494s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0e3b9b6d-86d1-4023-9abe-ad55d7d116f9 tempest-CreateVolumesFromImageTest-597456346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3a5722d8-7ec7-492c-8d30-4e95eb15cddc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:42 devstack sudo[97970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3a5722d8-7ec7-492c-8d30-4e95eb15cddc Sep 01 08:22:42 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:42 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0e3b9b6d-86d1-4023-9abe-ad55d7d116f9 tempest-CreateVolumesFromImageTest-597456346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3a5722d8-7ec7-492c-8d30-4e95eb15cddc" returned: 0 in 0.307s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0e3b9b6d-86d1-4023-9abe-ad55d7d116f9 tempest-CreateVolumesFromImageTest-597456346 None] Lock "cinder-quobyte-3a5722d8-7ec7-492c-8d30-4e95eb15cddc" released by "delete_volume" :: held 0.861s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:43 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-0e3b9b6d-86d1-4023-9abe-ad55d7d116f9 tempest-CreateVolumesFromImageTest-597456346 None] Created reservations ['77774294-cbfa-45f3-85cf-2131fe12fcf5', '0faf5672-5fa8-4028-aa70-bcd48acfdc72', 'dbe380f4-0782-44a0-93af-62965af769ee', '6700070b-541b-4270-a06b-8e0da76d050e'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:22:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0e3b9b6d-86d1-4023-9abe-ad55d7d116f9 tempest-CreateVolumesFromImageTest-597456346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0e3b9b6d-86d1-4023-9abe-ad55d7d116f9 tempest-CreateVolumesFromImageTest-597456346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:43 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0e3b9b6d-86d1-4023-9abe-ad55d7d116f9 tempest-CreateVolumesFromImageTest-597456346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:43 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0e3b9b6d-86d1-4023-9abe-ad55d7d116f9 tempest-CreateVolumesFromImageTest-597456346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0e3b9b6d-86d1-4023-9abe-ad55d7d116f9 tempest-CreateVolumesFromImageTest-597456346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0e3b9b6d-86d1-4023-9abe-ad55d7d116f9 tempest-CreateVolumesFromImageTest-597456346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:43 devstack sudo[97973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:22:43 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:43 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6178d49b-9c2b-425e-9ed6-0bfeecf978af tempest-CreateVolumesFromImageTest-597456346 None] Acquiring lock "cinder-b2f83ee1-823f-48ea-a33a-ae54bc77f616-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:43 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6178d49b-9c2b-425e-9ed6-0bfeecf978af tempest-CreateVolumesFromImageTest-597456346 None] Lock "cinder-b2f83ee1-823f-48ea-a33a-ae54bc77f616-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:43 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6178d49b-9c2b-425e-9ed6-0bfeecf978af tempest-CreateVolumesFromImageTest-597456346 None] Acquiring lock "cinder-quobyte-b2f83ee1-823f-48ea-a33a-ae54bc77f616" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:43 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6178d49b-9c2b-425e-9ed6-0bfeecf978af tempest-CreateVolumesFromImageTest-597456346 None] Lock "cinder-quobyte-b2f83ee1-823f-48ea-a33a-ae54bc77f616" acquired by "delete_volume" :: waited 0.021s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:43 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[e068c37d-31ed-44e8-ba7b-4c0f675c221d]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:22:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6178d49b-9c2b-425e-9ed6-0bfeecf978af tempest-CreateVolumesFromImageTest-597456346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b2f83ee1-823f-48ea-a33a-ae54bc77f616 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:43 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0e3b9b6d-86d1-4023-9abe-ad55d7d116f9 tempest-CreateVolumesFromImageTest-597456346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.375s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:43 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-0e3b9b6d-86d1-4023-9abe-ad55d7d116f9 tempest-CreateVolumesFromImageTest-597456346 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:22:43 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-0e3b9b6d-86d1-4023-9abe-ad55d7d116f9 tempest-CreateVolumesFromImageTest-597456346 None] Deleted volume successfully. Sep 01 08:22:43 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b2f83ee1-823f-48ea-a33a-ae54bc77f616 Sep 01 08:22:43 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:43 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0e3b9b6d-86d1-4023-9abe-ad55d7d116f9 tempest-CreateVolumesFromImageTest-597456346 None] Lock "cinder-3a5722d8-7ec7-492c-8d30-4e95eb15cddc-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:43 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6178d49b-9c2b-425e-9ed6-0bfeecf978af tempest-CreateVolumesFromImageTest-597456346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b2f83ee1-823f-48ea-a33a-ae54bc77f616" returned: 0 in 0.454s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6178d49b-9c2b-425e-9ed6-0bfeecf978af tempest-CreateVolumesFromImageTest-597456346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b2f83ee1-823f-48ea-a33a-ae54bc77f616 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:43 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b2f83ee1-823f-48ea-a33a-ae54bc77f616 Sep 01 08:22:43 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:44 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6178d49b-9c2b-425e-9ed6-0bfeecf978af tempest-CreateVolumesFromImageTest-597456346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b2f83ee1-823f-48ea-a33a-ae54bc77f616" returned: 0 in 0.299s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:44 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6178d49b-9c2b-425e-9ed6-0bfeecf978af tempest-CreateVolumesFromImageTest-597456346 None] Lock "cinder-quobyte-b2f83ee1-823f-48ea-a33a-ae54bc77f616" released by "delete_volume" :: held 0.813s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:44 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-6178d49b-9c2b-425e-9ed6-0bfeecf978af tempest-CreateVolumesFromImageTest-597456346 None] Created reservations ['39299bc2-b4c7-485a-8861-783d8c853d68', '7a8e7ab5-5313-48a1-b284-bc646e130986', 'ca3aec70-97b8-438f-a2f6-595adec288fa', '42f7e738-2984-4b28-a0ef-d8e7f3d22549'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:22:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6178d49b-9c2b-425e-9ed6-0bfeecf978af tempest-CreateVolumesFromImageTest-597456346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6178d49b-9c2b-425e-9ed6-0bfeecf978af tempest-CreateVolumesFromImageTest-597456346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:44 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6178d49b-9c2b-425e-9ed6-0bfeecf978af tempest-CreateVolumesFromImageTest-597456346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:44 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6178d49b-9c2b-425e-9ed6-0bfeecf978af tempest-CreateVolumesFromImageTest-597456346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6178d49b-9c2b-425e-9ed6-0bfeecf978af tempest-CreateVolumesFromImageTest-597456346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6178d49b-9c2b-425e-9ed6-0bfeecf978af tempest-CreateVolumesFromImageTest-597456346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:44 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:22:44 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:44 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4ca3df1b-ad0d-4c66-ac0f-4187060266a5 tempest-CreateVolumesFromImageTest-597456346 None] Acquiring lock "cinder-542b11b1-dd54-4be5-bb4a-b7af3fe63b6c-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:44 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4ca3df1b-ad0d-4c66-ac0f-4187060266a5 tempest-CreateVolumesFromImageTest-597456346 None] Lock "cinder-542b11b1-dd54-4be5-bb4a-b7af3fe63b6c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:44 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4ca3df1b-ad0d-4c66-ac0f-4187060266a5 tempest-CreateVolumesFromImageTest-597456346 None] Acquiring lock "cinder-quobyte-542b11b1-dd54-4be5-bb4a-b7af3fe63b6c" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:44 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4ca3df1b-ad0d-4c66-ac0f-4187060266a5 tempest-CreateVolumesFromImageTest-597456346 None] Lock "cinder-quobyte-542b11b1-dd54-4be5-bb4a-b7af3fe63b6c" acquired by "delete_volume" :: waited 0.024s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:44 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d121ab3-4cc7-4e8e-8c0a-13ad40dcdcf0]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:22:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4ca3df1b-ad0d-4c66-ac0f-4187060266a5 tempest-CreateVolumesFromImageTest-597456346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-542b11b1-dd54-4be5-bb4a-b7af3fe63b6c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:44 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6178d49b-9c2b-425e-9ed6-0bfeecf978af tempest-CreateVolumesFromImageTest-597456346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.415s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:44 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-6178d49b-9c2b-425e-9ed6-0bfeecf978af tempest-CreateVolumesFromImageTest-597456346 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:22:44 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-6178d49b-9c2b-425e-9ed6-0bfeecf978af tempest-CreateVolumesFromImageTest-597456346 None] Deleted volume successfully. Sep 01 08:22:44 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-542b11b1-dd54-4be5-bb4a-b7af3fe63b6c Sep 01 08:22:44 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:44 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6178d49b-9c2b-425e-9ed6-0bfeecf978af tempest-CreateVolumesFromImageTest-597456346 None] Lock "cinder-b2f83ee1-823f-48ea-a33a-ae54bc77f616-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:45 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4ca3df1b-ad0d-4c66-ac0f-4187060266a5 tempest-CreateVolumesFromImageTest-597456346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-542b11b1-dd54-4be5-bb4a-b7af3fe63b6c" returned: 0 in 0.561s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4ca3df1b-ad0d-4c66-ac0f-4187060266a5 tempest-CreateVolumesFromImageTest-597456346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-542b11b1-dd54-4be5-bb4a-b7af3fe63b6c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:45 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-542b11b1-dd54-4be5-bb4a-b7af3fe63b6c Sep 01 08:22:45 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:45 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4ca3df1b-ad0d-4c66-ac0f-4187060266a5 tempest-CreateVolumesFromImageTest-597456346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-542b11b1-dd54-4be5-bb4a-b7af3fe63b6c" returned: 0 in 0.292s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:45 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4ca3df1b-ad0d-4c66-ac0f-4187060266a5 tempest-CreateVolumesFromImageTest-597456346 None] Lock "cinder-quobyte-542b11b1-dd54-4be5-bb4a-b7af3fe63b6c" released by "delete_volume" :: held 0.915s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:45 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-4ca3df1b-ad0d-4c66-ac0f-4187060266a5 tempest-CreateVolumesFromImageTest-597456346 None] Created reservations ['ef8a7bfb-e14d-4261-ba15-c8b55b98dd97', 'c7ecab8e-df2f-4eb6-b336-a898bdc9fb7e', 'db742ccb-33f8-48ef-b1a6-f4f2a3dccad3', 'd4960b1a-a647-441c-8559-ad77d0ae27ef'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:22:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4ca3df1b-ad0d-4c66-ac0f-4187060266a5 tempest-CreateVolumesFromImageTest-597456346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4ca3df1b-ad0d-4c66-ac0f-4187060266a5 tempest-CreateVolumesFromImageTest-597456346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:45 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4ca3df1b-ad0d-4c66-ac0f-4187060266a5 tempest-CreateVolumesFromImageTest-597456346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:45 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4ca3df1b-ad0d-4c66-ac0f-4187060266a5 tempest-CreateVolumesFromImageTest-597456346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4ca3df1b-ad0d-4c66-ac0f-4187060266a5 tempest-CreateVolumesFromImageTest-597456346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4ca3df1b-ad0d-4c66-ac0f-4187060266a5 tempest-CreateVolumesFromImageTest-597456346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:45 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:22:45 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:46 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4ca3df1b-ad0d-4c66-ac0f-4187060266a5 tempest-CreateVolumesFromImageTest-597456346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.290s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:46 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-4ca3df1b-ad0d-4c66-ac0f-4187060266a5 tempest-CreateVolumesFromImageTest-597456346 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:22:46 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-4ca3df1b-ad0d-4c66-ac0f-4187060266a5 tempest-CreateVolumesFromImageTest-597456346 None] Deleted volume successfully. Sep 01 08:22:46 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4ca3df1b-ad0d-4c66-ac0f-4187060266a5 tempest-CreateVolumesFromImageTest-597456346 None] Lock "cinder-542b11b1-dd54-4be5-bb4a-b7af3fe63b6c-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:46 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:22:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] Flow 'volume_create_manager' (9a15cffa-962d-4263-9bbd-de02fd1244b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c39290-8da5-4f58-94ff-3f80cf7184a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c39290-8da5-4f58-94ff-3f80cf7184a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d8463c-6a73-4536-8c24-c8128b354352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd4e1812a6f4f17b0dbb5707b9ac577',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:47Z,use_quota=True,user_id='c9cae2eedbac476ca8f51c0fa19f262d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49defb52-ccee-4caf-b002-1ac07bc4a90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49defb52-ccee-4caf-b002-1ac07bc4a90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e536653d-d7e8-4b1b-9654-31719860f96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e536653d-d7e8-4b1b-9654-31719860f96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29d8463c-6a73-4536-8c24-c8128b354352', 'volume_name': 'volume-29d8463c-6a73-4536-8c24-c8128b354352', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed6bbc3-a159-4a6a-919e-39328cc79b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed6bbc3-a159-4a6a-919e-39328cc79b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e05ea56c-34f6-4521-9aa0-402ee3a236ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:46 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] Volume 29d8463c-6a73-4536-8c24-c8128b354352: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29d8463c-6a73-4536-8c24-c8128b354352', 'volume_size': 1} Sep 01 08:22:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d8463c-6a73-4536-8c24-c8128b354352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd4e1812a6f4f17b0dbb5707b9ac577',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:47Z,use_quota=True,user_id='c9cae2eedbac476ca8f51c0fa19f262d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:22:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] Creating volume 29d8463c-6a73-4536-8c24-c8128b354352 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:22:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:22:46 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:22:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-29d8463c-6a73-4536-8c24-c8128b354352 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:46 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-29d8463c-6a73-4536-8c24-c8128b354352 1073741824 Sep 01 08:22:46 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:47 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-29d8463c-6a73-4536-8c24-c8128b354352 1073741824" returned: 0 in 0.639s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-29d8463c-6a73-4536-8c24-c8128b354352 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:47 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-29d8463c-6a73-4536-8c24-c8128b354352 Sep 01 08:22:47 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:47 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:22:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] Flow 'volume_create_manager' (d7655081-2889-439a-bd44-78e14f7d795c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc3c3fcc-1703-404b-8568-9ca2bff5b96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc3c3fcc-1703-404b-8568-9ca2bff5b96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1155517030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe0e7e5-a2ae-4348-aa07-d873e7905b19,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='13b3c68064fe4e79b9e234f78f0fc340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:47Z,use_quota=True,user_id='a9d21afe08f24c11b56375f95a4c1bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5a61f69-c570-43d4-abbe-75b6eff8ddde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5a61f69-c570-43d4-abbe-75b6eff8ddde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297ba4a3-238c-49c0-9abe-c5e029c945b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297ba4a3-238c-49c0-9abe-c5e029c945b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebe0e7e5-a2ae-4348-aa07-d873e7905b19', 'volume_name': 'volume-ebe0e7e5-a2ae-4348-aa07-d873e7905b19', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c78d0434-514b-42e3-849e-74effb4bfba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c78d0434-514b-42e3-849e-74effb4bfba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a7db92-00c0-46fd-b42a-0d5805dd39e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:47 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] Volume ebe0e7e5-a2ae-4348-aa07-d873e7905b19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebe0e7e5-a2ae-4348-aa07-d873e7905b19', 'volume_size': 1} Sep 01 08:22:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:47 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-29d8463c-6a73-4536-8c24-c8128b354352" returned: 0 in 0.327s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:22:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.145s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1155517030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe0e7e5-a2ae-4348-aa07-d873e7905b19,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='13b3c68064fe4e79b9e234f78f0fc340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:47Z,use_quota=True,user_id='a9d21afe08f24c11b56375f95a4c1bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:22:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] Creating volume ebe0e7e5-a2ae-4348-aa07-d873e7905b19 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:22:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:22:47 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:22:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ebe0e7e5-a2ae-4348-aa07-d873e7905b19 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e05ea56c-34f6-4521-9aa0-402ee3a236ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29d8463c-6a73-4536-8c24-c8128b354352', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:47 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ebe0e7e5-a2ae-4348-aa07-d873e7905b19 1073741824 Sep 01 08:22:47 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (142aca0f-68f9-4f1b-a2e5-b040ceb0e0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:47 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] Volume volume-29d8463c-6a73-4536-8c24-c8128b354352 (29d8463c-6a73-4536-8c24-c8128b354352): created successfully Sep 01 08:22:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (142aca0f-68f9-4f1b-a2e5-b040ceb0e0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] Flow 'volume_create_manager' (9a15cffa-962d-4263-9bbd-de02fd1244b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:47 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-7b309fc1-3596-4732-af61-ae693c731ca6 tempest-CinderUnicodeTest-698050571 None] Created volume successfully. Sep 01 08:22:48 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ebe0e7e5-a2ae-4348-aa07-d873e7905b19 1073741824" returned: 0 in 0.551s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ebe0e7e5-a2ae-4348-aa07-d873e7905b19 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:48 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ebe0e7e5-a2ae-4348-aa07-d873e7905b19 Sep 01 08:22:48 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:48 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ebe0e7e5-a2ae-4348-aa07-d873e7905b19" returned: 0 in 0.300s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:48 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:22:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a7db92-00c0-46fd-b42a-0d5805dd39e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebe0e7e5-a2ae-4348-aa07-d873e7905b19', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b752023-e519-4208-98e7-b40e7da0d2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:48 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] Volume volume-ebe0e7e5-a2ae-4348-aa07-d873e7905b19 (ebe0e7e5-a2ae-4348-aa07-d873e7905b19): created successfully Sep 01 08:22:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b752023-e519-4208-98e7-b40e7da0d2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] Flow 'volume_create_manager' (d7655081-2889-439a-bd44-78e14f7d795c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:48 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-50b7ce48-0358-4673-bee1-c0db64fdd595 tempest-VolumesTestJSON-244931435 None] Created volume successfully. Sep 01 08:22:49 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:22:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] Flow 'volume_create_manager' (a78f542f-a86d-4ace-90be-9ffa84d291c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e3a7cc-bbdd-4267-8ad0-17d955b0e14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e3a7cc-bbdd-4267-8ad0-17d955b0e14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-452856285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f7966c-1fcc-4d3b-a696-68046f33e1bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd4e1812a6f4f17b0dbb5707b9ac577',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:49Z,use_quota=True,user_id='c9cae2eedbac476ca8f51c0fa19f262d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e4dea35-e9ca-4252-99b7-d6b74255d853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e4dea35-e9ca-4252-99b7-d6b74255d853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a239989-b47e-431a-aa71-156f411c709e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a239989-b47e-431a-aa71-156f411c709e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36f7966c-1fcc-4d3b-a696-68046f33e1bc', 'volume_name': 'volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e11f2e3-cebc-4526-af1f-ef5b2563b524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e11f2e3-cebc-4526-af1f-ef5b2563b524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73f2217a-ad75-4321-b056-1f2d03d16acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:49 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] Volume 36f7966c-1fcc-4d3b-a696-68046f33e1bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc', 'volume_size': 1} Sep 01 08:22:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:49 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-452856285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f7966c-1fcc-4d3b-a696-68046f33e1bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd4e1812a6f4f17b0dbb5707b9ac577',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:49Z,use_quota=True,user_id='c9cae2eedbac476ca8f51c0fa19f262d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:22:49 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] Creating volume 36f7966c-1fcc-4d3b-a696-68046f33e1bc {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:22:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:49 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:49 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:49 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:22:49 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:22:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:49 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc 1073741824 Sep 01 08:22:49 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:50 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc 1073741824" returned: 0 in 0.564s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:50 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc Sep 01 08:22:50 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] Flow 'volume_create_manager' (dd567253-c842-41c9-a7ea-96c3f1c2eb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd5ef24-ede7-4701-b0fd-7745f568089a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd5ef24-ede7-4701-b0fd-7745f568089a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-441836242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b4a9e7-5b0b-4a4b-ac49-22faa9cd2bee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='13b3c68064fe4e79b9e234f78f0fc340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:50Z,use_quota=True,user_id='a9d21afe08f24c11b56375f95a4c1bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b6b5c7-7de2-4531-8cfb-8e234c5d9023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b6b5c7-7de2-4531-8cfb-8e234c5d9023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19b84f4-cf57-4f03-a920-552c8e132bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19b84f4-cf57-4f03-a920-552c8e132bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44b4a9e7-5b0b-4a4b-ac49-22faa9cd2bee', 'volume_name': 'volume-44b4a9e7-5b0b-4a4b-ac49-22faa9cd2bee', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fed61ff-302d-403e-be61-e6063f595dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fed61ff-302d-403e-be61-e6063f595dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9335b7f7-e4a3-4602-80a2-25c05ee9714e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:50 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] Volume 44b4a9e7-5b0b-4a4b-ac49-22faa9cd2bee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44b4a9e7-5b0b-4a4b-ac49-22faa9cd2bee', 'volume_size': 1} Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:50 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc" returned: 0 in 0.327s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.124s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-441836242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b4a9e7-5b0b-4a4b-ac49-22faa9cd2bee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='13b3c68064fe4e79b9e234f78f0fc340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:50Z,use_quota=True,user_id='a9d21afe08f24c11b56375f95a4c1bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] Creating volume 44b4a9e7-5b0b-4a4b-ac49-22faa9cd2bee {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:22:50 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-44b4a9e7-5b0b-4a4b-ac49-22faa9cd2bee 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73f2217a-ad75-4321-b056-1f2d03d16acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (918ab501-73eb-42d0-a385-e300301027fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:50 devstack sudo[98029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-44b4a9e7-5b0b-4a4b-ac49-22faa9cd2bee 1073741824 Sep 01 08:22:50 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:50 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] Volume volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc (36f7966c-1fcc-4d3b-a696-68046f33e1bc): created successfully Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (918ab501-73eb-42d0-a385-e300301027fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] Flow 'volume_create_manager' (a78f542f-a86d-4ace-90be-9ffa84d291c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:50 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-df9d49eb-bfc7-42b0-8880-9d539a7f2ec3 tempest-CinderUnicodeTest-698050571 None] Created volume successfully. Sep 01 08:22:50 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-44b4a9e7-5b0b-4a4b-ac49-22faa9cd2bee 1073741824" returned: 0 in 0.521s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-44b4a9e7-5b0b-4a4b-ac49-22faa9cd2bee {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:51 devstack sudo[98035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-44b4a9e7-5b0b-4a4b-ac49-22faa9cd2bee Sep 01 08:22:51 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:51 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-44b4a9e7-5b0b-4a4b-ac49-22faa9cd2bee" returned: 0 in 0.275s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:51 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:22:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9335b7f7-e4a3-4602-80a2-25c05ee9714e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44b4a9e7-5b0b-4a4b-ac49-22faa9cd2bee', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7221c3f-3f22-4134-ad8c-1c120609fa32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:51 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] Volume volume-44b4a9e7-5b0b-4a4b-ac49-22faa9cd2bee (44b4a9e7-5b0b-4a4b-ac49-22faa9cd2bee): created successfully Sep 01 08:22:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7221c3f-3f22-4134-ad8c-1c120609fa32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] Flow 'volume_create_manager' (dd567253-c842-41c9-a7ea-96c3f1c2eb48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:51 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-b94f52df-0dbb-4971-95b8-15396b533104 tempest-VolumesTestJSON-244931435 None] Created volume successfully. Sep 01 08:22:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d0e7d3b2-98a6-4500-a7ab-de5b66dbd02b tempest-CinderUnicodeTest-698050571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d0e7d3b2-98a6-4500-a7ab-de5b66dbd02b tempest-CinderUnicodeTest-698050571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:51 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-d0e7d3b2-98a6-4500-a7ab-de5b66dbd02b tempest-CinderUnicodeTest-698050571 None] Creating offline snapshot 60e40b00-4b78-4002-bd5f-028c9d015179 of volume 36f7966c-1fcc-4d3b-a696-68046f33e1bc {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:22:51 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[038907de-e7d2-4be5-ad67-f46ae357f7de]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:22:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d0e7d3b2-98a6-4500-a7ab-de5b66dbd02b tempest-CinderUnicodeTest-698050571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:51 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc Sep 01 08:22:51 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:52 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d0e7d3b2-98a6-4500-a7ab-de5b66dbd02b tempest-CinderUnicodeTest-698050571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc" returned: 0 in 0.441s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d0e7d3b2-98a6-4500-a7ab-de5b66dbd02b tempest-CinderUnicodeTest-698050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc.60e40b00-4b78-4002-bd5f-028c9d015179 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:52 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc.60e40b00-4b78-4002-bd5f-028c9d015179 1G Sep 01 08:22:52 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:52 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d0e7d3b2-98a6-4500-a7ab-de5b66dbd02b tempest-CinderUnicodeTest-698050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc.60e40b00-4b78-4002-bd5f-028c9d015179 1G" returned: 0 in 0.683s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d0e7d3b2-98a6-4500-a7ab-de5b66dbd02b tempest-CinderUnicodeTest-698050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc.60e40b00-4b78-4002-bd5f-028c9d015179 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:52 devstack sudo[98048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc.60e40b00-4b78-4002-bd5f-028c9d015179 Sep 01 08:22:53 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:53 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:22:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] Flow 'volume_create_manager' (12060a86-e5af-483c-8e31-e8a3cf012fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c9697c1-5f8a-496c-9ebb-66b13fd36a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c9697c1-5f8a-496c-9ebb-66b13fd36a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1285368288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01187f5b-be8c-42db-9966-1caba3968360,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='13b3c68064fe4e79b9e234f78f0fc340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:53Z,use_quota=True,user_id='a9d21afe08f24c11b56375f95a4c1bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74f0238-8e1f-4254-986f-6971dfc756b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74f0238-8e1f-4254-986f-6971dfc756b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4b0f213-48bd-48c4-850d-7616a2a042dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4b0f213-48bd-48c4-850d-7616a2a042dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01187f5b-be8c-42db-9966-1caba3968360', 'volume_name': 'volume-01187f5b-be8c-42db-9966-1caba3968360', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e778e0-6b58-498b-bbdf-0b5970997080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e778e0-6b58-498b-bbdf-0b5970997080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc6012ba-e6f1-4e7b-b5dc-b853cd015839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:53 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] Volume 01187f5b-be8c-42db-9966-1caba3968360: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01187f5b-be8c-42db-9966-1caba3968360', 'volume_size': 1} Sep 01 08:22:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:53 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d0e7d3b2-98a6-4500-a7ab-de5b66dbd02b tempest-CinderUnicodeTest-698050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc.60e40b00-4b78-4002-bd5f-028c9d015179" returned: 0 in 0.398s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:53 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-d0e7d3b2-98a6-4500-a7ab-de5b66dbd02b tempest-CinderUnicodeTest-698050571 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc.60e40b00-4b78-4002-bd5f-028c9d015179 is being set with open permissions: ugo+rw Sep 01 08:22:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d0e7d3b2-98a6-4500-a7ab-de5b66dbd02b tempest-CinderUnicodeTest-698050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc.60e40b00-4b78-4002-bd5f-028c9d015179 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:53 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc.60e40b00-4b78-4002-bd5f-028c9d015179 Sep 01 08:22:53 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:53 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d0e7d3b2-98a6-4500-a7ab-de5b66dbd02b tempest-CinderUnicodeTest-698050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc.60e40b00-4b78-4002-bd5f-028c9d015179" returned: 0 in 0.273s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d0e7d3b2-98a6-4500-a7ab-de5b66dbd02b tempest-CinderUnicodeTest-698050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:53 devstack sudo[98058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc.info Sep 01 08:22:53 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:53 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d0e7d3b2-98a6-4500-a7ab-de5b66dbd02b tempest-CinderUnicodeTest-698050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc.info" returned: 0 in 0.273s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:53 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-d0e7d3b2-98a6-4500-a7ab-de5b66dbd02b tempest-CinderUnicodeTest-698050571 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc.info is being set with open permissions: ugo+rw Sep 01 08:22:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d0e7d3b2-98a6-4500-a7ab-de5b66dbd02b tempest-CinderUnicodeTest-698050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:53 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc.info Sep 01 08:22:53 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:54 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d0e7d3b2-98a6-4500-a7ab-de5b66dbd02b tempest-CinderUnicodeTest-698050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc.info" returned: 0 in 0.291s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d0e7d3b2-98a6-4500-a7ab-de5b66dbd02b tempest-CinderUnicodeTest-698050571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.499s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.075s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1285368288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01187f5b-be8c-42db-9966-1caba3968360,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='13b3c68064fe4e79b9e234f78f0fc340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:53Z,use_quota=True,user_id='a9d21afe08f24c11b56375f95a4c1bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:22:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] Creating volume 01187f5b-be8c-42db-9966-1caba3968360 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:22:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:22:54 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:22:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-01187f5b-be8c-42db-9966-1caba3968360 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:54 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-01187f5b-be8c-42db-9966-1caba3968360 1073741824 Sep 01 08:22:54 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:54 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-d0e7d3b2-98a6-4500-a7ab-de5b66dbd02b tempest-CinderUnicodeTest-698050571 None] Create snapshot completed successfully Sep 01 08:22:54 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-01187f5b-be8c-42db-9966-1caba3968360 1073741824" returned: 0 in 0.491s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-01187f5b-be8c-42db-9966-1caba3968360 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:54 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-01187f5b-be8c-42db-9966-1caba3968360 Sep 01 08:22:54 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-aa7c59a4-2bfd-4c64-af94-ed3b700e6820 tempest-CinderUnicodeTest-698050571 None] Acquiring lock "cinder-60e40b00-4b78-4002-bd5f-028c9d015179-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-aa7c59a4-2bfd-4c64-af94-ed3b700e6820 tempest-CinderUnicodeTest-698050571 None] Lock "cinder-60e40b00-4b78-4002-bd5f-028c9d015179-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-aa7c59a4-2bfd-4c64-af94-ed3b700e6820 tempest-CinderUnicodeTest-698050571 None] Acquiring lock "cinder-quobyte-36f7966c-1fcc-4d3b-a696-68046f33e1bc" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-aa7c59a4-2bfd-4c64-af94-ed3b700e6820 tempest-CinderUnicodeTest-698050571 None] Lock "cinder-quobyte-36f7966c-1fcc-4d3b-a696-68046f33e1bc" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-aa7c59a4-2bfd-4c64-af94-ed3b700e6820 tempest-CinderUnicodeTest-698050571 None] Acquiring lock "cinder-quobyte-60e40b00-4b78-4002-bd5f-028c9d015179" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-aa7c59a4-2bfd-4c64-af94-ed3b700e6820 tempest-CinderUnicodeTest-698050571 None] Lock "cinder-quobyte-60e40b00-4b78-4002-bd5f-028c9d015179" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:55 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-aa7c59a4-2bfd-4c64-af94-ed3b700e6820 tempest-CinderUnicodeTest-698050571 None] Deleting offline snapshot 60e40b00-4b78-4002-bd5f-028c9d015179 of volume 36f7966c-1fcc-4d3b-a696-68046f33e1bc {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:22:55 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-aa7c59a4-2bfd-4c64-af94-ed3b700e6820 tempest-CinderUnicodeTest-698050571 None] snapshot_file for this snap is: volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc.60e40b00-4b78-4002-bd5f-028c9d015179 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:22:55 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b1fa8c-8685-4dfc-a820-d90712c7d79f]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:22:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-aa7c59a4-2bfd-4c64-af94-ed3b700e6820 tempest-CinderUnicodeTest-698050571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc.60e40b00-4b78-4002-bd5f-028c9d015179 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:55 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-01187f5b-be8c-42db-9966-1caba3968360" returned: 0 in 0.371s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:55 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:22:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc6012ba-e6f1-4e7b-b5dc-b853cd015839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01187f5b-be8c-42db-9966-1caba3968360', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b0c51a-55e5-4198-8e02-574bd735cc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:55 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] Volume volume-01187f5b-be8c-42db-9966-1caba3968360 (01187f5b-be8c-42db-9966-1caba3968360): created successfully Sep 01 08:22:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b0c51a-55e5-4198-8e02-574bd735cc61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] Flow 'volume_create_manager' (12060a86-e5af-483c-8e31-e8a3cf012fae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:55 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-3b518058-ca9f-4d6a-9699-713d6b9da080 tempest-VolumesTestJSON-244931435 None] Created volume successfully. Sep 01 08:22:55 devstack sudo[98073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc.60e40b00-4b78-4002-bd5f-028c9d015179 Sep 01 08:22:55 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:55 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-aa7c59a4-2bfd-4c64-af94-ed3b700e6820 tempest-CinderUnicodeTest-698050571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc.60e40b00-4b78-4002-bd5f-028c9d015179" returned: 0 in 0.416s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:55 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-aa7c59a4-2bfd-4c64-af94-ed3b700e6820 tempest-CinderUnicodeTest-698050571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:22:55 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[624880b7-0f49-45cf-b230-4aebe25383cf]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:22:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-aa7c59a4-2bfd-4c64-af94-ed3b700e6820 tempest-CinderUnicodeTest-698050571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:55 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc Sep 01 08:22:55 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:56 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-aa7c59a4-2bfd-4c64-af94-ed3b700e6820 tempest-CinderUnicodeTest-698050571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc" returned: 0 in 0.435s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-aa7c59a4-2bfd-4c64-af94-ed3b700e6820 tempest-CinderUnicodeTest-698050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc.60e40b00-4b78-4002-bd5f-028c9d015179 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:56 devstack sudo[98084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc.60e40b00-4b78-4002-bd5f-028c9d015179 Sep 01 08:22:56 devstack sudo[98084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:56 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-efd62d7f-0b61-42d3-9996-84482a4958f0 tempest-GroupSnapshotsTest-2124917916 None] Group tempest-GroupSnapshotsTest-Group-765318173: creating Sep 01 08:22:56 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-efd62d7f-0b61-42d3-9996-84482a4958f0 tempest-GroupSnapshotsTest-2124917916 None] Group tempest-GroupSnapshotsTest-Group-765318173: created successfully Sep 01 08:22:56 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-efd62d7f-0b61-42d3-9996-84482a4958f0 tempest-GroupSnapshotsTest-2124917916 None] Create group completed successfully. Sep 01 08:22:56 devstack sudo[98084]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-aa7c59a4-2bfd-4c64-af94-ed3b700e6820 tempest-CinderUnicodeTest-698050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc.60e40b00-4b78-4002-bd5f-028c9d015179" returned: 0 in 0.428s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-aa7c59a4-2bfd-4c64-af94-ed3b700e6820 tempest-CinderUnicodeTest-698050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc.60e40b00-4b78-4002-bd5f-028c9d015179 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:56 devstack sudo[98089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc.60e40b00-4b78-4002-bd5f-028c9d015179 Sep 01 08:22:56 devstack sudo[98089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:56 devstack sudo[98089]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-aa7c59a4-2bfd-4c64-af94-ed3b700e6820 tempest-CinderUnicodeTest-698050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc.60e40b00-4b78-4002-bd5f-028c9d015179" returned: 0 in 0.311s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-aa7c59a4-2bfd-4c64-af94-ed3b700e6820 tempest-CinderUnicodeTest-698050571 None] Lock "cinder-quobyte-60e40b00-4b78-4002-bd5f-028c9d015179" released by "_delete_snapshot" :: held 1.725s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-aa7c59a4-2bfd-4c64-af94-ed3b700e6820 tempest-CinderUnicodeTest-698050571 None] Lock "cinder-quobyte-36f7966c-1fcc-4d3b-a696-68046f33e1bc" released by "delete_snapshot" :: held 1.754s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:56 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-aa7c59a4-2bfd-4c64-af94-ed3b700e6820 tempest-CinderUnicodeTest-698050571 None] Created reservations ['85a1c756-3d1f-4b2c-b659-47fc1b97e863', 'b26bd221-708d-44e3-9eba-31a164c5f0f3', 'b4c597bf-f811-4ada-9f5a-23ff8ec93b5c', 'f84c818e-60bd-4761-91de-eecf5916544f'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:22:56 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-aa7c59a4-2bfd-4c64-af94-ed3b700e6820 tempest-CinderUnicodeTest-698050571 None] Delete snapshot completed successfully. Sep 01 08:22:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-aa7c59a4-2bfd-4c64-af94-ed3b700e6820 tempest-CinderUnicodeTest-698050571 None] Lock "cinder-60e40b00-4b78-4002-bd5f-028c9d015179-delete_snapshot" released by "delete_snapshot" :: held 1.923s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-c6f6ced5-31d8-4da4-8ec3-c3e978b2c67a tempest-CinderUnicodeTest-698050571 None] Acquiring lock "cinder-36f7966c-1fcc-4d3b-a696-68046f33e1bc-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-c6f6ced5-31d8-4da4-8ec3-c3e978b2c67a tempest-CinderUnicodeTest-698050571 None] Lock "cinder-36f7966c-1fcc-4d3b-a696-68046f33e1bc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-c6f6ced5-31d8-4da4-8ec3-c3e978b2c67a tempest-CinderUnicodeTest-698050571 None] Acquiring lock "cinder-quobyte-36f7966c-1fcc-4d3b-a696-68046f33e1bc" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-c6f6ced5-31d8-4da4-8ec3-c3e978b2c67a tempest-CinderUnicodeTest-698050571 None] Lock "cinder-quobyte-36f7966c-1fcc-4d3b-a696-68046f33e1bc" acquired by "delete_volume" :: waited 0.021s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:57 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[7817cd40-d58c-45ff-b016-31db6191825d]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:22:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c6f6ced5-31d8-4da4-8ec3-c3e978b2c67a tempest-CinderUnicodeTest-698050571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:57 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc Sep 01 08:22:57 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-aa8ef3b7-581b-48a8-81d1-aa26cddbea5f tempest-VolumesTestJSON-244931435 None] Acquiring lock "cinder-01187f5b-be8c-42db-9966-1caba3968360-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-aa8ef3b7-581b-48a8-81d1-aa26cddbea5f tempest-VolumesTestJSON-244931435 None] Lock "cinder-01187f5b-be8c-42db-9966-1caba3968360-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-aa8ef3b7-581b-48a8-81d1-aa26cddbea5f tempest-VolumesTestJSON-244931435 None] Acquiring lock "cinder-quobyte-01187f5b-be8c-42db-9966-1caba3968360" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-aa8ef3b7-581b-48a8-81d1-aa26cddbea5f tempest-VolumesTestJSON-244931435 None] Lock "cinder-quobyte-01187f5b-be8c-42db-9966-1caba3968360" acquired by "delete_volume" :: waited 0.026s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:57 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c6f6ced5-31d8-4da4-8ec3-c3e978b2c67a tempest-CinderUnicodeTest-698050571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc" returned: 0 in 0.520s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c6f6ced5-31d8-4da4-8ec3-c3e978b2c67a tempest-CinderUnicodeTest-698050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:57 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef3ab57-12d0-481f-9dfc-2e69af4fc493]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:22:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-aa8ef3b7-581b-48a8-81d1-aa26cddbea5f tempest-VolumesTestJSON-244931435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-01187f5b-be8c-42db-9966-1caba3968360 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:57 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc Sep 01 08:22:57 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:58 devstack sudo[98099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-01187f5b-be8c-42db-9966-1caba3968360 Sep 01 08:22:58 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] Flow 'volume_create_manager' (3c59edee-4a48-4051-a780-535c7ce6b9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd972b3-326d-470e-bc5a-da504b3e2fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd972b3-326d-470e-bc5a-da504b3e2fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-668669584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c014e2d4-710c-4939-a4e4-f137cb69c5fe,host='devstack@QuobyteHD#QuobyteHD',id=60a21b41-1a98-40c9-a732-ebad294528c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='398f1e5b275b4d57924f6d60ecfb7b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:58Z,use_quota=True,user_id='97b2795a14024d93bdd8a1e9312459bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea56c41-93b7-421d-b9d8-5e571b17b440),volume_type_id=2ea56c41-93b7-421d-b9d8-5e571b17b440)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6af64418-6a68-4ee7-93c8-17e827955959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6af64418-6a68-4ee7-93c8-17e827955959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a02253-22e7-4498-b726-5feb5077f4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:58 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a02253-22e7-4498-b726-5feb5077f4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60a21b41-1a98-40c9-a732-ebad294528c5', 'volume_name': 'volume-60a21b41-1a98-40c9-a732-ebad294528c5', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c25c3831-7d7b-485e-baa8-04619ab9adba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c25c3831-7d7b-485e-baa8-04619ab9adba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b960f47e-4fee-4edc-b8bd-3590258b3fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:58 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] Volume 60a21b41-1a98-40c9-a732-ebad294528c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60a21b41-1a98-40c9-a732-ebad294528c5', 'volume_size': 1} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c014e2d4-710c-4939-a4e4-f137cb69c5fe,created_at=2026-09-01T06:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-668669584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c014e2d4-710c-4939-a4e4-f137cb69c5fe,host='devstack@QuobyteHD#QuobyteHD',id=60a21b41-1a98-40c9-a732-ebad294528c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='398f1e5b275b4d57924f6d60ecfb7b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:22:58Z,use_quota=True,user_id='97b2795a14024d93bdd8a1e9312459bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea56c41-93b7-421d-b9d8-5e571b17b440),volume_type_id=2ea56c41-93b7-421d-b9d8-5e571b17b440)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] Creating volume 60a21b41-1a98-40c9-a732-ebad294528c5 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:22:58 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c6f6ced5-31d8-4da4-8ec3-c3e978b2c67a tempest-CinderUnicodeTest-698050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-36f7966c-1fcc-4d3b-a696-68046f33e1bc" returned: 0 in 0.418s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:58 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5 1073741824 Sep 01 08:22:58 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-c6f6ced5-31d8-4da4-8ec3-c3e978b2c67a tempest-CinderUnicodeTest-698050571 None] Lock "cinder-quobyte-36f7966c-1fcc-4d3b-a696-68046f33e1bc" released by "delete_volume" :: held 1.009s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:58 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-aa8ef3b7-581b-48a8-81d1-aa26cddbea5f tempest-VolumesTestJSON-244931435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-01187f5b-be8c-42db-9966-1caba3968360" returned: 0 in 0.488s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-aa8ef3b7-581b-48a8-81d1-aa26cddbea5f tempest-VolumesTestJSON-244931435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-01187f5b-be8c-42db-9966-1caba3968360 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-c6f6ced5-31d8-4da4-8ec3-c3e978b2c67a tempest-CinderUnicodeTest-698050571 None] Created reservations ['914587fe-7f61-4de2-b871-d92260bf6aff', '65c0bcf0-1263-4c8f-a564-70f7ee92f65b', 'c070fe4a-1299-4f92-a136-1743c8949cf1', 'f864857a-a438-4ed4-a5d5-f848e2b29bd2'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:22:58 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-01187f5b-be8c-42db-9966-1caba3968360 Sep 01 08:22:58 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c6f6ced5-31d8-4da4-8ec3-c3e978b2c67a tempest-CinderUnicodeTest-698050571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c6f6ced5-31d8-4da4-8ec3-c3e978b2c67a tempest-CinderUnicodeTest-698050571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c6f6ced5-31d8-4da4-8ec3-c3e978b2c67a tempest-CinderUnicodeTest-698050571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c6f6ced5-31d8-4da4-8ec3-c3e978b2c67a tempest-CinderUnicodeTest-698050571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c6f6ced5-31d8-4da4-8ec3-c3e978b2c67a tempest-CinderUnicodeTest-698050571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c6f6ced5-31d8-4da4-8ec3-c3e978b2c67a tempest-CinderUnicodeTest-698050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:58 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:22:58 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:58 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-aa8ef3b7-581b-48a8-81d1-aa26cddbea5f tempest-VolumesTestJSON-244931435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-01187f5b-be8c-42db-9966-1caba3968360" returned: 0 in 0.327s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-aa8ef3b7-581b-48a8-81d1-aa26cddbea5f tempest-VolumesTestJSON-244931435 None] Lock "cinder-quobyte-01187f5b-be8c-42db-9966-1caba3968360" released by "delete_volume" :: held 0.882s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-aa8ef3b7-581b-48a8-81d1-aa26cddbea5f tempest-VolumesTestJSON-244931435 None] Created reservations ['0b3cdbf4-74ac-4d64-aa68-b74631576f72', '6c2cbee3-03b0-44d8-82c6-9855bb6d0e1b', '349fd215-f366-41e2-9c43-ac2ee4c77898', '31b67409-e655-4694-91bc-3ff01397107b'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:22:58 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c6f6ced5-31d8-4da4-8ec3-c3e978b2c67a tempest-CinderUnicodeTest-698050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.321s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-c6f6ced5-31d8-4da4-8ec3-c3e978b2c67a tempest-CinderUnicodeTest-698050571 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:22:58 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-c6f6ced5-31d8-4da4-8ec3-c3e978b2c67a tempest-CinderUnicodeTest-698050571 None] Deleted volume successfully. Sep 01 08:22:58 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5 1073741824" returned: 0 in 0.576s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-c6f6ced5-31d8-4da4-8ec3-c3e978b2c67a tempest-CinderUnicodeTest-698050571 None] Lock "cinder-36f7966c-1fcc-4d3b-a696-68046f33e1bc-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-aa8ef3b7-581b-48a8-81d1-aa26cddbea5f tempest-VolumesTestJSON-244931435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-aa8ef3b7-581b-48a8-81d1-aa26cddbea5f tempest-VolumesTestJSON-244931435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-aa8ef3b7-581b-48a8-81d1-aa26cddbea5f tempest-VolumesTestJSON-244931435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:22:58 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5 Sep 01 08:22:58 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-aa8ef3b7-581b-48a8-81d1-aa26cddbea5f tempest-VolumesTestJSON-244931435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-aa8ef3b7-581b-48a8-81d1-aa26cddbea5f tempest-VolumesTestJSON-244931435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-aa8ef3b7-581b-48a8-81d1-aa26cddbea5f tempest-VolumesTestJSON-244931435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:59 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:22:59 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-58f30f47-d508-4799-bf9a-950d1310f43b tempest-VolumesTestJSON-244931435 None] Acquiring lock "cinder-44b4a9e7-5b0b-4a4b-ac49-22faa9cd2bee-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-58f30f47-d508-4799-bf9a-950d1310f43b tempest-VolumesTestJSON-244931435 None] Lock "cinder-44b4a9e7-5b0b-4a4b-ac49-22faa9cd2bee-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-58f30f47-d508-4799-bf9a-950d1310f43b tempest-VolumesTestJSON-244931435 None] Acquiring lock "cinder-quobyte-44b4a9e7-5b0b-4a4b-ac49-22faa9cd2bee" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-58f30f47-d508-4799-bf9a-950d1310f43b tempest-VolumesTestJSON-244931435 None] Lock "cinder-quobyte-44b4a9e7-5b0b-4a4b-ac49-22faa9cd2bee" acquired by "delete_volume" :: waited 0.019s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b192b6-4d80-4a9c-8cf6-ce8d05c1a066]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-58f30f47-d508-4799-bf9a-950d1310f43b tempest-VolumesTestJSON-244931435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-44b4a9e7-5b0b-4a4b-ac49-22faa9cd2bee {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:59 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5" returned: 0 in 0.329s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b960f47e-4fee-4edc-b8bd-3590258b3fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60a21b41-1a98-40c9-a732-ebad294528c5', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:59 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b2760a-bd9f-415f-9427-05de8f1d90d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:22:59 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-44b4a9e7-5b0b-4a4b-ac49-22faa9cd2bee Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-aa8ef3b7-581b-48a8-81d1-aa26cddbea5f tempest-VolumesTestJSON-244931435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.314s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:59 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-aa8ef3b7-581b-48a8-81d1-aa26cddbea5f tempest-VolumesTestJSON-244931435 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:22:59 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-aa8ef3b7-581b-48a8-81d1-aa26cddbea5f tempest-VolumesTestJSON-244931435 None] Deleted volume successfully. Sep 01 08:22:59 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] Volume volume-60a21b41-1a98-40c9-a732-ebad294528c5 (60a21b41-1a98-40c9-a732-ebad294528c5): created successfully Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b2760a-bd9f-415f-9427-05de8f1d90d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] Flow 'volume_create_manager' (3c59edee-4a48-4051-a780-535c7ce6b9b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:22:59 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-250101f5-6933-48d3-8eb9-b415553e4034 tempest-GroupSnapshotsTest-2124917916 None] Created volume successfully. Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-aa8ef3b7-581b-48a8-81d1-aa26cddbea5f tempest-VolumesTestJSON-244931435 None] Lock "cinder-01187f5b-be8c-42db-9966-1caba3968360-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6f945f58-108b-4cf1-96a7-6551f6e5103e tempest-CinderUnicodeTest-698050571 None] Acquiring lock "cinder-29d8463c-6a73-4536-8c24-c8128b354352-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6f945f58-108b-4cf1-96a7-6551f6e5103e tempest-CinderUnicodeTest-698050571 None] Lock "cinder-29d8463c-6a73-4536-8c24-c8128b354352-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6f945f58-108b-4cf1-96a7-6551f6e5103e tempest-CinderUnicodeTest-698050571 None] Acquiring lock "cinder-quobyte-29d8463c-6a73-4536-8c24-c8128b354352" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6f945f58-108b-4cf1-96a7-6551f6e5103e tempest-CinderUnicodeTest-698050571 None] Lock "cinder-quobyte-29d8463c-6a73-4536-8c24-c8128b354352" acquired by "delete_volume" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:22:59 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-58f30f47-d508-4799-bf9a-950d1310f43b tempest-VolumesTestJSON-244931435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-44b4a9e7-5b0b-4a4b-ac49-22faa9cd2bee" returned: 0 in 0.522s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-58f30f47-d508-4799-bf9a-950d1310f43b tempest-VolumesTestJSON-244931435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-44b4a9e7-5b0b-4a4b-ac49-22faa9cd2bee {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[63916b74-080f-41e7-9034-5e394600ec30]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:22:59 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-e1ef0458-69b0-47c0-ad34-80ccf8111e87 tempest-GroupSnapshotsTest-2124917916 None] GroupSnapshot 5c97b7c3-d9fd-4968-bf4c-6725a66d033a: creating. Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6f945f58-108b-4cf1-96a7-6551f6e5103e tempest-CinderUnicodeTest-698050571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-29d8463c-6a73-4536-8c24-c8128b354352 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:59 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-44b4a9e7-5b0b-4a4b-ac49-22faa9cd2bee Sep 01 08:22:59 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e1ef0458-69b0-47c0-ad34-80ccf8111e87 tempest-GroupSnapshotsTest-2124917916 None] Group snapshot 5c97b7c3-d9fd-4968-bf4c-6725a66d033a: creating. {{(pid=86893) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e1ef0458-69b0-47c0-ad34-80ccf8111e87 tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e1ef0458-69b0-47c0-ad34-80ccf8111e87 tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-e1ef0458-69b0-47c0-ad34-80ccf8111e87 tempest-GroupSnapshotsTest-2124917916 None] Creating offline snapshot bcc61a18-8e03-462f-921c-57d7494c5b40 of volume 60a21b41-1a98-40c9-a732-ebad294528c5 {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed9a4b8-182a-485f-ad40-56e233200ae2]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:22:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e1ef0458-69b0-47c0-ad34-80ccf8111e87 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:22:59 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-29d8463c-6a73-4536-8c24-c8128b354352 Sep 01 08:22:59 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:00 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5 Sep 01 08:23:00 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:00 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-58f30f47-d508-4799-bf9a-950d1310f43b tempest-VolumesTestJSON-244931435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-44b4a9e7-5b0b-4a4b-ac49-22faa9cd2bee" returned: 0 in 0.394s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:00 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-58f30f47-d508-4799-bf9a-950d1310f43b tempest-VolumesTestJSON-244931435 None] Lock "cinder-quobyte-44b4a9e7-5b0b-4a4b-ac49-22faa9cd2bee" released by "delete_volume" :: held 0.965s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:00 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-58f30f47-d508-4799-bf9a-950d1310f43b tempest-VolumesTestJSON-244931435 None] Created reservations ['0321b926-223a-40c7-b1ba-dc12cecc6e62', '5e530f25-cf14-450f-a501-0e11023a2b10', '8b1a106c-677c-4e35-a570-2851486d0f93', '2452b048-bd3e-47d1-8bee-9f8db56bc4ba'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:23:00 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6f945f58-108b-4cf1-96a7-6551f6e5103e tempest-CinderUnicodeTest-698050571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-29d8463c-6a73-4536-8c24-c8128b354352" returned: 0 in 0.558s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6f945f58-108b-4cf1-96a7-6551f6e5103e tempest-CinderUnicodeTest-698050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-29d8463c-6a73-4536-8c24-c8128b354352 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-58f30f47-d508-4799-bf9a-950d1310f43b tempest-VolumesTestJSON-244931435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-58f30f47-d508-4799-bf9a-950d1310f43b tempest-VolumesTestJSON-244931435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:00 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-58f30f47-d508-4799-bf9a-950d1310f43b tempest-VolumesTestJSON-244931435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:00 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-58f30f47-d508-4799-bf9a-950d1310f43b tempest-VolumesTestJSON-244931435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-58f30f47-d508-4799-bf9a-950d1310f43b tempest-VolumesTestJSON-244931435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-58f30f47-d508-4799-bf9a-950d1310f43b tempest-VolumesTestJSON-244931435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:00 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-29d8463c-6a73-4536-8c24-c8128b354352 Sep 01 08:23:00 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:00 devstack sudo[98143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:23:00 devstack sudo[98143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:00 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e1ef0458-69b0-47c0-ad34-80ccf8111e87 tempest-GroupSnapshotsTest-2124917916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5" returned: 0 in 0.505s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e1ef0458-69b0-47c0-ad34-80ccf8111e87 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5.bcc61a18-8e03-462f-921c-57d7494c5b40 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:00 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5.bcc61a18-8e03-462f-921c-57d7494c5b40 1G Sep 01 08:23:00 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:00 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6f945f58-108b-4cf1-96a7-6551f6e5103e tempest-CinderUnicodeTest-698050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-29d8463c-6a73-4536-8c24-c8128b354352" returned: 0 in 0.273s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:00 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6f945f58-108b-4cf1-96a7-6551f6e5103e tempest-CinderUnicodeTest-698050571 None] Lock "cinder-quobyte-29d8463c-6a73-4536-8c24-c8128b354352" released by "delete_volume" :: held 0.904s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:00 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-6f945f58-108b-4cf1-96a7-6551f6e5103e tempest-CinderUnicodeTest-698050571 None] Created reservations ['b4c2df6b-1502-4424-afc8-92e323f7e7cd', 'a4e68fac-b54b-4c93-9b21-b3d2bf762510', '761fcea9-6f71-449b-8627-d35819125316', 'b72597b3-739d-4e9d-bbfc-9dff389f8310'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:23:00 devstack sudo[98143]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-58f30f47-d508-4799-bf9a-950d1310f43b tempest-VolumesTestJSON-244931435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.373s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:00 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-58f30f47-d508-4799-bf9a-950d1310f43b tempest-VolumesTestJSON-244931435 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:23:00 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-58f30f47-d508-4799-bf9a-950d1310f43b tempest-VolumesTestJSON-244931435 None] Deleted volume successfully. Sep 01 08:23:00 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-58f30f47-d508-4799-bf9a-950d1310f43b tempest-VolumesTestJSON-244931435 None] Lock "cinder-44b4a9e7-5b0b-4a4b-ac49-22faa9cd2bee-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6f945f58-108b-4cf1-96a7-6551f6e5103e tempest-CinderUnicodeTest-698050571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6f945f58-108b-4cf1-96a7-6551f6e5103e tempest-CinderUnicodeTest-698050571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:00 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6f945f58-108b-4cf1-96a7-6551f6e5103e tempest-CinderUnicodeTest-698050571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:00 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6f945f58-108b-4cf1-96a7-6551f6e5103e tempest-CinderUnicodeTest-698050571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6f945f58-108b-4cf1-96a7-6551f6e5103e tempest-CinderUnicodeTest-698050571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6f945f58-108b-4cf1-96a7-6551f6e5103e tempest-CinderUnicodeTest-698050571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:00 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:23:00 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:00 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e1ef0458-69b0-47c0-ad34-80ccf8111e87 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5.bcc61a18-8e03-462f-921c-57d7494c5b40 1G" returned: 0 in 0.546s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e1ef0458-69b0-47c0-ad34-80ccf8111e87 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60a21b41-1a98-40c9-a732-ebad294528c5 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5.bcc61a18-8e03-462f-921c-57d7494c5b40 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:00 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60a21b41-1a98-40c9-a732-ebad294528c5 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5.bcc61a18-8e03-462f-921c-57d7494c5b40 Sep 01 08:23:00 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:01 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6f945f58-108b-4cf1-96a7-6551f6e5103e tempest-CinderUnicodeTest-698050571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.274s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:01 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-6f945f58-108b-4cf1-96a7-6551f6e5103e tempest-CinderUnicodeTest-698050571 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:23:01 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-6f945f58-108b-4cf1-96a7-6551f6e5103e tempest-CinderUnicodeTest-698050571 None] Deleted volume successfully. Sep 01 08:23:01 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6f945f58-108b-4cf1-96a7-6551f6e5103e tempest-CinderUnicodeTest-698050571 None] Lock "cinder-29d8463c-6a73-4536-8c24-c8128b354352-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:01 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e1ef0458-69b0-47c0-ad34-80ccf8111e87 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60a21b41-1a98-40c9-a732-ebad294528c5 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5.bcc61a18-8e03-462f-921c-57d7494c5b40" returned: 0 in 0.304s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:01 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-e1ef0458-69b0-47c0-ad34-80ccf8111e87 tempest-GroupSnapshotsTest-2124917916 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5.bcc61a18-8e03-462f-921c-57d7494c5b40 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 08:23:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e1ef0458-69b0-47c0-ad34-80ccf8111e87 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5.bcc61a18-8e03-462f-921c-57d7494c5b40 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:01 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5.bcc61a18-8e03-462f-921c-57d7494c5b40 Sep 01 08:23:01 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:01 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-afb798a1-7b76-47da-898c-f4671a7675ed tempest-VolumesTestJSON-244931435 None] Acquiring lock "cinder-ebe0e7e5-a2ae-4348-aa07-d873e7905b19-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:01 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-afb798a1-7b76-47da-898c-f4671a7675ed tempest-VolumesTestJSON-244931435 None] Lock "cinder-ebe0e7e5-a2ae-4348-aa07-d873e7905b19-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:01 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-afb798a1-7b76-47da-898c-f4671a7675ed tempest-VolumesTestJSON-244931435 None] Acquiring lock "cinder-quobyte-ebe0e7e5-a2ae-4348-aa07-d873e7905b19" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:01 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-afb798a1-7b76-47da-898c-f4671a7675ed tempest-VolumesTestJSON-244931435 None] Lock "cinder-quobyte-ebe0e7e5-a2ae-4348-aa07-d873e7905b19" acquired by "delete_volume" :: waited 0.024s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:01 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7255b62-8f07-4ad0-801a-b72eec83e487]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:23:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-afb798a1-7b76-47da-898c-f4671a7675ed tempest-VolumesTestJSON-244931435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ebe0e7e5-a2ae-4348-aa07-d873e7905b19 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:01 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e1ef0458-69b0-47c0-ad34-80ccf8111e87 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5.bcc61a18-8e03-462f-921c-57d7494c5b40" returned: 0 in 0.270s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e1ef0458-69b0-47c0-ad34-80ccf8111e87 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:01 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5.info Sep 01 08:23:01 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:01 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ebe0e7e5-a2ae-4348-aa07-d873e7905b19 Sep 01 08:23:01 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:01 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e1ef0458-69b0-47c0-ad34-80ccf8111e87 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5.info" returned: 0 in 0.386s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:01 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-e1ef0458-69b0-47c0-ad34-80ccf8111e87 tempest-GroupSnapshotsTest-2124917916 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 08:23:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e1ef0458-69b0-47c0-ad34-80ccf8111e87 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:01 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5.info Sep 01 08:23:01 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:02 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-afb798a1-7b76-47da-898c-f4671a7675ed tempest-VolumesTestJSON-244931435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ebe0e7e5-a2ae-4348-aa07-d873e7905b19" returned: 0 in 0.592s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-afb798a1-7b76-47da-898c-f4671a7675ed tempest-VolumesTestJSON-244931435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ebe0e7e5-a2ae-4348-aa07-d873e7905b19 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:02 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ebe0e7e5-a2ae-4348-aa07-d873e7905b19 Sep 01 08:23:02 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:02 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e1ef0458-69b0-47c0-ad34-80ccf8111e87 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5.info" returned: 0 in 0.433s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e1ef0458-69b0-47c0-ad34-80ccf8111e87 tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.571s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:02 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=202,cinder:UPDATE=262,cinder:DELETE=24,cinder:INSERT=61 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:23:02 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:UPDATE=254,cinder:SELECT=193,cinder:INSERT=58,cinder:DELETE=20 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:23:02 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-afb798a1-7b76-47da-898c-f4671a7675ed tempest-VolumesTestJSON-244931435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ebe0e7e5-a2ae-4348-aa07-d873e7905b19" returned: 0 in 0.373s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:02 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-afb798a1-7b76-47da-898c-f4671a7675ed tempest-VolumesTestJSON-244931435 None] Lock "cinder-quobyte-ebe0e7e5-a2ae-4348-aa07-d873e7905b19" released by "delete_volume" :: held 1.032s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:02 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-e1ef0458-69b0-47c0-ad34-80ccf8111e87 tempest-GroupSnapshotsTest-2124917916 None] group_snapshot 5c97b7c3-d9fd-4968-bf4c-6725a66d033a: created successfully Sep 01 08:23:02 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-afb798a1-7b76-47da-898c-f4671a7675ed tempest-VolumesTestJSON-244931435 None] Created reservations ['0fcf5a3a-c4b3-4397-8fca-e3d8f25481e7', 'a5288da2-986d-46ae-864d-ec113f9ef818', 'e8b28790-778d-4cae-8f1e-a0bacbad8de3', '8be42b49-79b9-407b-9604-6cb10ad87d57'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:23:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-afb798a1-7b76-47da-898c-f4671a7675ed tempest-VolumesTestJSON-244931435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-afb798a1-7b76-47da-898c-f4671a7675ed tempest-VolumesTestJSON-244931435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:02 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-afb798a1-7b76-47da-898c-f4671a7675ed tempest-VolumesTestJSON-244931435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:02 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-afb798a1-7b76-47da-898c-f4671a7675ed tempest-VolumesTestJSON-244931435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-afb798a1-7b76-47da-898c-f4671a7675ed tempest-VolumesTestJSON-244931435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-afb798a1-7b76-47da-898c-f4671a7675ed tempest-VolumesTestJSON-244931435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:02 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:23:02 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:02 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-afb798a1-7b76-47da-898c-f4671a7675ed tempest-VolumesTestJSON-244931435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.304s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:02 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-afb798a1-7b76-47da-898c-f4671a7675ed tempest-VolumesTestJSON-244931435 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:23:02 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-afb798a1-7b76-47da-898c-f4671a7675ed tempest-VolumesTestJSON-244931435 None] Deleted volume successfully. Sep 01 08:23:02 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-afb798a1-7b76-47da-898c-f4671a7675ed tempest-VolumesTestJSON-244931435 None] Lock "cinder-ebe0e7e5-a2ae-4348-aa07-d873e7905b19-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:03 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "cinder-quobyte-bcc61a18-8e03-462f-921c-57d7494c5b40-e49d7848-47c2-4f67-bae3-5d3131a9e578" by "_create_volume_from_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:03 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] Lock "cinder-quobyte-bcc61a18-8e03-462f-921c-57d7494c5b40-e49d7848-47c2-4f67-bae3-5d3131a9e578" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:03 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] Creating volume e49d7848-47c2-4f67-bae3-5d3131a9e578 from snapshot bcc61a18-8e03-462f-921c-57d7494c5b40 {{(pid=86893) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 08:23:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:03 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:03 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:03 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:23:03 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "cinder-quobyte-e49d7848-47c2-4f67-bae3-5d3131a9e578" by "_copy_volume_from_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:03 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] Lock "cinder-quobyte-e49d7848-47c2-4f67-bae3-5d3131a9e578" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:03 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] snapshot: bcc61a18-8e03-462f-921c-57d7494c5b40, volume: e49d7848-47c2-4f67-bae3-5d3131a9e578, {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 08:23:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:04 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:04 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:04 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5fd000-0441-4a4c-95c4-e6a9c305aa48]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:23:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5.bcc61a18-8e03-462f-921c-57d7494c5b40 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:04 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5.bcc61a18-8e03-462f-921c-57d7494c5b40 Sep 01 08:23:04 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:04 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5.bcc61a18-8e03-462f-921c-57d7494c5b40" returned: 0 in 0.413s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:04 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60a21b41-1a98-40c9-a732-ebad294528c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:23:04 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[294910d7-bac1-4562-b4bd-c64ef9496f75]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:23:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:04 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5 Sep 01 08:23:04 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:04 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5" returned: 0 in 0.502s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:04 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5 {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 08:23:04 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] Creating direct copy from snapshot {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 08:23:04 devstack cinder-volume[86893]: DEBUG cinder.utils [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] Path /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e49d7848-47c2-4f67-bae3-5d3131a9e578 not found in is_blk_device check {{(pid=86893) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 08:23:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e49d7848-47c2-4f67-bae3-5d3131a9e578 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:05 devstack sudo[98197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e49d7848-47c2-4f67-bae3-5d3131a9e578 Sep 01 08:23:05 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:11 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e49d7848-47c2-4f67-bae3-5d3131a9e578" returned: 0 in 6.855s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:11 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] Image conversion details: src /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5, size 1024.00 MB, duration 6.86 sec, destination /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e49d7848-47c2-4f67-bae3-5d3131a9e578 {{(pid=86893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 08:23:11 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] Converted 1024.00 MB image at 149.33 MB/s Sep 01 08:23:11 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e49d7848-47c2-4f67-bae3-5d3131a9e578 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 08:23:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e49d7848-47c2-4f67-bae3-5d3131a9e578 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:11 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e49d7848-47c2-4f67-bae3-5d3131a9e578 Sep 01 08:23:11 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:12 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e49d7848-47c2-4f67-bae3-5d3131a9e578" returned: 0 in 0.370s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:12 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] Lock "cinder-quobyte-e49d7848-47c2-4f67-bae3-5d3131a9e578" released by "_copy_volume_from_snapshot" :: held 8.360s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:12 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] Lock "cinder-quobyte-bcc61a18-8e03-462f-921c-57d7494c5b40-e49d7848-47c2-4f67-bae3-5d3131a9e578" released by "_create_volume_from_snapshot" :: held 8.484s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.520s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:12 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-79958071-6cc9-4692-98be-7d8d13e3f13f tempest-GroupSnapshotsTest-2124917916 None] Create group from source-snapshot-5c97b7c3-d9fd-4968-bf4c-6725a66d033a completed successfully. Sep 01 08:23:13 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-24f60f12-7156-4a17-9a02-9481a401874b tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "cinder-quobyte-e49d7848-47c2-4f67-bae3-5d3131a9e578" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:13 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-24f60f12-7156-4a17-9a02-9481a401874b tempest-GroupSnapshotsTest-2124917916 None] Lock "cinder-quobyte-e49d7848-47c2-4f67-bae3-5d3131a9e578" acquired by "delete_volume" :: waited 0.026s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:13 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec2b184-65e3-4cb4-98ca-d21da8596604]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:23:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-24f60f12-7156-4a17-9a02-9481a401874b tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e49d7848-47c2-4f67-bae3-5d3131a9e578 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:13 devstack sudo[98256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e49d7848-47c2-4f67-bae3-5d3131a9e578 Sep 01 08:23:13 devstack sudo[98256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:13 devstack sudo[98256]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-24f60f12-7156-4a17-9a02-9481a401874b tempest-GroupSnapshotsTest-2124917916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e49d7848-47c2-4f67-bae3-5d3131a9e578" returned: 0 in 0.534s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-24f60f12-7156-4a17-9a02-9481a401874b tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e49d7848-47c2-4f67-bae3-5d3131a9e578 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:13 devstack sudo[98261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e49d7848-47c2-4f67-bae3-5d3131a9e578 Sep 01 08:23:13 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:14 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-24f60f12-7156-4a17-9a02-9481a401874b tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e49d7848-47c2-4f67-bae3-5d3131a9e578" returned: 0 in 0.327s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:14 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-24f60f12-7156-4a17-9a02-9481a401874b tempest-GroupSnapshotsTest-2124917916 None] Lock "cinder-quobyte-e49d7848-47c2-4f67-bae3-5d3131a9e578" released by "delete_volume" :: held 0.935s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:14 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-24f60f12-7156-4a17-9a02-9481a401874b tempest-GroupSnapshotsTest-2124917916 None] Created reservations ['b21d0712-c079-4e17-a5f8-1995c12580a4'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:23:14 devstack cinder-volume[86893]: WARNING cinder.quota [None req-24f60f12-7156-4a17-9a02-9481a401874b tempest-GroupSnapshotsTest-2124917916 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-522733447 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-522733447, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:23:14 devstack cinder-volume[86893]: WARNING cinder.quota [None req-24f60f12-7156-4a17-9a02-9481a401874b tempest-GroupSnapshotsTest-2124917916 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-522733447 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-522733447, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:23:14 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-24f60f12-7156-4a17-9a02-9481a401874b tempest-GroupSnapshotsTest-2124917916 None] Created reservations ['a943d3a6-1a8d-4583-bd88-e8bbe288ae4d', 'a905799b-6083-4d14-9a69-d48961c88d9f', '7b1b8f07-c3a4-4f35-87eb-ae0153206649', '112aac12-4fb4-4f19-a945-0a3aee0c982b'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:23:14 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-47709c58-7e43-4f37-9362-11d4054a3823 tempest-GroupsTest-1925360788 None] Group tempest-Group1-84837561: creating Sep 01 08:23:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-24f60f12-7156-4a17-9a02-9481a401874b tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-24f60f12-7156-4a17-9a02-9481a401874b tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:14 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-24f60f12-7156-4a17-9a02-9481a401874b tempest-GroupSnapshotsTest-2124917916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:14 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-24f60f12-7156-4a17-9a02-9481a401874b tempest-GroupSnapshotsTest-2124917916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-24f60f12-7156-4a17-9a02-9481a401874b tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-24f60f12-7156-4a17-9a02-9481a401874b tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:14 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:23:14 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:14 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-47709c58-7e43-4f37-9362-11d4054a3823 tempest-GroupsTest-1925360788 None] Group tempest-Group1-84837561: created successfully Sep 01 08:23:14 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-47709c58-7e43-4f37-9362-11d4054a3823 tempest-GroupsTest-1925360788 None] Create group completed successfully. Sep 01 08:23:14 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-24f60f12-7156-4a17-9a02-9481a401874b tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.285s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:14 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-24f60f12-7156-4a17-9a02-9481a401874b tempest-GroupSnapshotsTest-2124917916 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:23:14 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-24f60f12-7156-4a17-9a02-9481a401874b tempest-GroupSnapshotsTest-2124917916 None] Delete group completed successfully. Sep 01 08:23:15 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-d655428f-8cec-4363-95e2-cf783b2fdb31 tempest-GroupSnapshotsTest-2124917916 None] group_snapshot 5c97b7c3-d9fd-4968-bf4c-6725a66d033a: deleting Sep 01 08:23:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d655428f-8cec-4363-95e2-cf783b2fdb31 tempest-GroupSnapshotsTest-2124917916 None] group_snapshot 5c97b7c3-d9fd-4968-bf4c-6725a66d033a: deleting {{(pid=86893) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 08:23:15 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-492019c9-2549-48f5-b928-85e9df563c79 tempest-GroupsTest-1925360788 None] Group tempest-Group2-278503041: creating Sep 01 08:23:15 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d655428f-8cec-4363-95e2-cf783b2fdb31 tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "cinder-quobyte-60a21b41-1a98-40c9-a732-ebad294528c5" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:15 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d655428f-8cec-4363-95e2-cf783b2fdb31 tempest-GroupSnapshotsTest-2124917916 None] Lock "cinder-quobyte-60a21b41-1a98-40c9-a732-ebad294528c5" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:15 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d655428f-8cec-4363-95e2-cf783b2fdb31 tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "cinder-quobyte-bcc61a18-8e03-462f-921c-57d7494c5b40" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:15 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-492019c9-2549-48f5-b928-85e9df563c79 tempest-GroupsTest-1925360788 None] Group tempest-Group2-278503041: created successfully Sep 01 08:23:15 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d655428f-8cec-4363-95e2-cf783b2fdb31 tempest-GroupSnapshotsTest-2124917916 None] Lock "cinder-quobyte-bcc61a18-8e03-462f-921c-57d7494c5b40" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-d655428f-8cec-4363-95e2-cf783b2fdb31 tempest-GroupSnapshotsTest-2124917916 None] Deleting offline snapshot bcc61a18-8e03-462f-921c-57d7494c5b40 of volume 60a21b41-1a98-40c9-a732-ebad294528c5 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:23:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-d655428f-8cec-4363-95e2-cf783b2fdb31 tempest-GroupSnapshotsTest-2124917916 None] snapshot_file for this snap is: volume-60a21b41-1a98-40c9-a732-ebad294528c5.bcc61a18-8e03-462f-921c-57d7494c5b40 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:23:15 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[501dabf2-e1a2-45f4-a2b6-6b7fe9e11264]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:23:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d655428f-8cec-4363-95e2-cf783b2fdb31 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5.bcc61a18-8e03-462f-921c-57d7494c5b40 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:15 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-492019c9-2549-48f5-b928-85e9df563c79 tempest-GroupsTest-1925360788 None] Create group completed successfully. Sep 01 08:23:15 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5.bcc61a18-8e03-462f-921c-57d7494c5b40 Sep 01 08:23:15 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:16 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d655428f-8cec-4363-95e2-cf783b2fdb31 tempest-GroupSnapshotsTest-2124917916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5.bcc61a18-8e03-462f-921c-57d7494c5b40" returned: 0 in 0.418s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-d655428f-8cec-4363-95e2-cf783b2fdb31 tempest-GroupSnapshotsTest-2124917916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60a21b41-1a98-40c9-a732-ebad294528c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:23:16 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51edf7a-e2eb-4c3e-ba16-33676046e413]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:23:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d655428f-8cec-4363-95e2-cf783b2fdb31 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:16 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5 Sep 01 08:23:16 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:16 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d655428f-8cec-4363-95e2-cf783b2fdb31 tempest-GroupSnapshotsTest-2124917916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5" returned: 0 in 0.582s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d655428f-8cec-4363-95e2-cf783b2fdb31 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5.bcc61a18-8e03-462f-921c-57d7494c5b40 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:16 devstack sudo[98277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5.bcc61a18-8e03-462f-921c-57d7494c5b40 Sep 01 08:23:16 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:17 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d655428f-8cec-4363-95e2-cf783b2fdb31 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5.bcc61a18-8e03-462f-921c-57d7494c5b40" returned: 0 in 0.540s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d655428f-8cec-4363-95e2-cf783b2fdb31 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5.bcc61a18-8e03-462f-921c-57d7494c5b40 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:17 devstack sudo[98284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5.bcc61a18-8e03-462f-921c-57d7494c5b40 Sep 01 08:23:17 devstack sudo[98284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:17 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:23:17 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] Flow 'volume_create_manager' (cee21830-4d8a-4945-af4f-27a53c543cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:23:17 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29981f93-f48f-4b4b-a51e-bae8a84fbaef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:17 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29981f93-f48f-4b4b-a51e-bae8a84fbaef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2133375904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=11444925-33e0-468c-b9a8-61948bb48bb9,host='devstack@QuobyteHD#QuobyteHD',id=2d15d1ea-dd67-48ab-b045-fad47f048041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a6120fa2ad4b6dbbc5a7b85db1bfaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:23:17Z,use_quota=True,user_id='6d861bd19e574794a2af9aa9b5fd535d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22a12fc8-6ce3-437c-bbdd-7591a6603459),volume_type_id=22a12fc8-6ce3-437c-bbdd-7591a6603459)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:17 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c741282a-da19-45cb-a1ac-e45267926cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:17 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c741282a-da19-45cb-a1ac-e45267926cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:17 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b94f941a-4067-4add-b38f-be9dfb4f6e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:17 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b94f941a-4067-4add-b38f-be9dfb4f6e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d15d1ea-dd67-48ab-b045-fad47f048041', 'volume_name': 'volume-2d15d1ea-dd67-48ab-b045-fad47f048041', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:17 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8021ad96-1125-4aee-a773-811110b3aecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:17 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8021ad96-1125-4aee-a773-811110b3aecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:17 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (433efdae-cf4f-40ce-a6fc-6871d20b15b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:17 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] Volume 2d15d1ea-dd67-48ab-b045-fad47f048041: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d15d1ea-dd67-48ab-b045-fad47f048041', 'volume_size': 1} Sep 01 08:23:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:17 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=11444925-33e0-468c-b9a8-61948bb48bb9,created_at=2026-09-01T06:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2133375904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=11444925-33e0-468c-b9a8-61948bb48bb9,host='devstack@QuobyteHD#QuobyteHD',id=2d15d1ea-dd67-48ab-b045-fad47f048041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a6120fa2ad4b6dbbc5a7b85db1bfaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:23:17Z,use_quota=True,user_id='6d861bd19e574794a2af9aa9b5fd535d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22a12fc8-6ce3-437c-bbdd-7591a6603459),volume_type_id=22a12fc8-6ce3-437c-bbdd-7591a6603459)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:23:17 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] Creating volume 2d15d1ea-dd67-48ab-b045-fad47f048041 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:23:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:17 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:17 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:17 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:23:17 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:23:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2d15d1ea-dd67-48ab-b045-fad47f048041 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:17 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2d15d1ea-dd67-48ab-b045-fad47f048041 1073741824 Sep 01 08:23:17 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:17 devstack sudo[98284]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d655428f-8cec-4363-95e2-cf783b2fdb31 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5.bcc61a18-8e03-462f-921c-57d7494c5b40" returned: 0 in 0.488s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:17 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d655428f-8cec-4363-95e2-cf783b2fdb31 tempest-GroupSnapshotsTest-2124917916 None] Lock "cinder-quobyte-bcc61a18-8e03-462f-921c-57d7494c5b40" released by "_delete_snapshot" :: held 2.212s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:17 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d655428f-8cec-4363-95e2-cf783b2fdb31 tempest-GroupSnapshotsTest-2124917916 None] Lock "cinder-quobyte-60a21b41-1a98-40c9-a732-ebad294528c5" released by "delete_snapshot" :: held 2.261s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:18 devstack cinder-volume[86893]: WARNING cinder.quota [None req-d655428f-8cec-4363-95e2-cf783b2fdb31 tempest-GroupSnapshotsTest-2124917916 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-522733447 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-522733447, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:23:18 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-d655428f-8cec-4363-95e2-cf783b2fdb31 tempest-GroupSnapshotsTest-2124917916 None] Created reservations ['2edc4438-0a75-4429-a1bb-c256ecb9431b', 'ccb9d0f0-881d-43ff-b52a-7ad3509173b6', '5e3049d7-44d8-4cd5-a968-63bf09ee9450', '041c6585-4718-4023-a701-2f5f98d47f0c'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:23:18 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-d655428f-8cec-4363-95e2-cf783b2fdb31 tempest-GroupSnapshotsTest-2124917916 None] group_snapshot 5c97b7c3-d9fd-4968-bf4c-6725a66d033a: deleted successfully Sep 01 08:23:18 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2d15d1ea-dd67-48ab-b045-fad47f048041 1073741824" returned: 0 in 0.739s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2d15d1ea-dd67-48ab-b045-fad47f048041 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:18 devstack sudo[98293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2d15d1ea-dd67-48ab-b045-fad47f048041 Sep 01 08:23:18 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:18 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2d15d1ea-dd67-48ab-b045-fad47f048041" returned: 0 in 0.297s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:18 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:23:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:18 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (433efdae-cf4f-40ce-a6fc-6871d20b15b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d15d1ea-dd67-48ab-b045-fad47f048041', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:18 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1057625-c18e-4fe0-b33f-9af9ee9d3e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:18 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] Volume volume-2d15d1ea-dd67-48ab-b045-fad47f048041 (2d15d1ea-dd67-48ab-b045-fad47f048041): created successfully Sep 01 08:23:18 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1057625-c18e-4fe0-b33f-9af9ee9d3e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:18 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] Flow 'volume_create_manager' (cee21830-4d8a-4945-af4f-27a53c543cfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:23:18 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-22b94d19-4818-4b76-9b56-f7331899b7e0 tempest-GroupsTest-1925360788 None] Created volume successfully. Sep 01 08:23:19 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bd7db8ec-e3c5-47be-a175-f944e7167f09 tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "cinder-quobyte-60a21b41-1a98-40c9-a732-ebad294528c5" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:19 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bd7db8ec-e3c5-47be-a175-f944e7167f09 tempest-GroupSnapshotsTest-2124917916 None] Lock "cinder-quobyte-60a21b41-1a98-40c9-a732-ebad294528c5" acquired by "delete_volume" :: waited 0.024s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:19 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[931c760e-82c5-4393-add8-2d12af29f1ed]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:23:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bd7db8ec-e3c5-47be-a175-f944e7167f09 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:19 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5 Sep 01 08:23:19 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:20 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bd7db8ec-e3c5-47be-a175-f944e7167f09 tempest-GroupSnapshotsTest-2124917916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5" returned: 0 in 0.518s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bd7db8ec-e3c5-47be-a175-f944e7167f09 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:20 devstack sudo[98303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5 Sep 01 08:23:20 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:20 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bd7db8ec-e3c5-47be-a175-f944e7167f09 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-60a21b41-1a98-40c9-a732-ebad294528c5" returned: 0 in 0.379s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bd7db8ec-e3c5-47be-a175-f944e7167f09 tempest-GroupSnapshotsTest-2124917916 None] Lock "cinder-quobyte-60a21b41-1a98-40c9-a732-ebad294528c5" released by "delete_volume" :: held 1.008s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:20 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-bd7db8ec-e3c5-47be-a175-f944e7167f09 tempest-GroupSnapshotsTest-2124917916 None] Created reservations ['f5520c54-7fe3-42ff-8ab1-d12fa818d690'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:23:20 devstack cinder-volume[86893]: WARNING cinder.db.api [None req-bd7db8ec-e3c5-47be-a175-f944e7167f09 tempest-GroupSnapshotsTest-2124917916 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-522733447'] Sep 01 08:23:20 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-bd7db8ec-e3c5-47be-a175-f944e7167f09 tempest-GroupSnapshotsTest-2124917916 None] Created reservations ['55199b2c-582a-40aa-bede-20ceb1681d3a', '3ab2460f-a3b5-47b1-b4c4-8a8714151337', '86b85083-4e27-4ba3-ac10-d0c971d5d3eb', 'a3010366-5a8a-4579-80ac-2ff1cc7150e6'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:23:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bd7db8ec-e3c5-47be-a175-f944e7167f09 tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bd7db8ec-e3c5-47be-a175-f944e7167f09 tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bd7db8ec-e3c5-47be-a175-f944e7167f09 tempest-GroupSnapshotsTest-2124917916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bd7db8ec-e3c5-47be-a175-f944e7167f09 tempest-GroupSnapshotsTest-2124917916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bd7db8ec-e3c5-47be-a175-f944e7167f09 tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bd7db8ec-e3c5-47be-a175-f944e7167f09 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:20 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:23:20 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e4d61f33-fc17-40ca-92d2-817647baa844 tempest-GroupsTest-1925360788 None] Acquiring lock "cinder-quobyte-2d15d1ea-dd67-48ab-b045-fad47f048041" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e4d61f33-fc17-40ca-92d2-817647baa844 tempest-GroupsTest-1925360788 None] Lock "cinder-quobyte-2d15d1ea-dd67-48ab-b045-fad47f048041" acquired by "delete_volume" :: waited 0.019s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:20 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[436fdd5f-9aa2-4c23-8016-4e53b889d341]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:23:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e4d61f33-fc17-40ca-92d2-817647baa844 tempest-GroupsTest-1925360788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2d15d1ea-dd67-48ab-b045-fad47f048041 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:21 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2d15d1ea-dd67-48ab-b045-fad47f048041 Sep 01 08:23:21 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:21 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bd7db8ec-e3c5-47be-a175-f944e7167f09 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.357s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:21 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-bd7db8ec-e3c5-47be-a175-f944e7167f09 tempest-GroupSnapshotsTest-2124917916 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:23:21 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-bd7db8ec-e3c5-47be-a175-f944e7167f09 tempest-GroupSnapshotsTest-2124917916 None] Delete group completed successfully. Sep 01 08:23:21 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e4d61f33-fc17-40ca-92d2-817647baa844 tempest-GroupsTest-1925360788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2d15d1ea-dd67-48ab-b045-fad47f048041" returned: 0 in 0.512s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e4d61f33-fc17-40ca-92d2-817647baa844 tempest-GroupsTest-1925360788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2d15d1ea-dd67-48ab-b045-fad47f048041 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:21 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2d15d1ea-dd67-48ab-b045-fad47f048041 Sep 01 08:23:21 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:21 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e4d61f33-fc17-40ca-92d2-817647baa844 tempest-GroupsTest-1925360788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2d15d1ea-dd67-48ab-b045-fad47f048041" returned: 0 in 0.292s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:21 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e4d61f33-fc17-40ca-92d2-817647baa844 tempest-GroupsTest-1925360788 None] Lock "cinder-quobyte-2d15d1ea-dd67-48ab-b045-fad47f048041" released by "delete_volume" :: held 0.874s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:21 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-e4d61f33-fc17-40ca-92d2-817647baa844 tempest-GroupsTest-1925360788 None] Created reservations ['38894d11-11ba-4da9-b5fa-c86814984dd5'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:23:21 devstack cinder-volume[86893]: WARNING cinder.quota [None req-e4d61f33-fc17-40ca-92d2-817647baa844 tempest-GroupsTest-1925360788 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1374272413 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1374272413, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:23:21 devstack cinder-volume[86893]: WARNING cinder.quota [None req-e4d61f33-fc17-40ca-92d2-817647baa844 tempest-GroupsTest-1925360788 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1374272413 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1374272413, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:23:21 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-e4d61f33-fc17-40ca-92d2-817647baa844 tempest-GroupsTest-1925360788 None] Created reservations ['d9efba0b-46c2-4922-b0e9-756cfa3c0826', '6d894848-bbd9-420a-bc00-046af2493c63', 'f5dd16d2-44cb-43c2-9b30-b41d6023a8e0', 'd81d44e5-903e-426f-9fdc-964ef39af147'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:23:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e4d61f33-fc17-40ca-92d2-817647baa844 tempest-GroupsTest-1925360788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e4d61f33-fc17-40ca-92d2-817647baa844 tempest-GroupsTest-1925360788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e4d61f33-fc17-40ca-92d2-817647baa844 tempest-GroupsTest-1925360788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e4d61f33-fc17-40ca-92d2-817647baa844 tempest-GroupsTest-1925360788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e4d61f33-fc17-40ca-92d2-817647baa844 tempest-GroupsTest-1925360788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e4d61f33-fc17-40ca-92d2-817647baa844 tempest-GroupsTest-1925360788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:22 devstack sudo[98319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:23:22 devstack sudo[98319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:22 devstack sudo[98319]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e4d61f33-fc17-40ca-92d2-817647baa844 tempest-GroupsTest-1925360788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.323s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:22 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-e4d61f33-fc17-40ca-92d2-817647baa844 tempest-GroupsTest-1925360788 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:23:22 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-e4d61f33-fc17-40ca-92d2-817647baa844 tempest-GroupsTest-1925360788 None] Delete group completed successfully. Sep 01 08:23:22 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-d79dd1a8-cfca-49a2-8ae1-6d0a71f991f5 tempest-GroupsTest-1925360788 None] Created reservations ['8a684698-2bfb-409f-9f0e-12932ed9305f'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:23:22 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-2ae3b71d-2f48-4949-894e-7c6116781ee7 tempest-GroupSnapshotsTest-2124917916 None] Group tempest-GroupSnapshotsTest-Group-1053540184: creating Sep 01 08:23:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d79dd1a8-cfca-49a2-8ae1-6d0a71f991f5 tempest-GroupsTest-1925360788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d79dd1a8-cfca-49a2-8ae1-6d0a71f991f5 tempest-GroupsTest-1925360788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d79dd1a8-cfca-49a2-8ae1-6d0a71f991f5 tempest-GroupsTest-1925360788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d79dd1a8-cfca-49a2-8ae1-6d0a71f991f5 tempest-GroupsTest-1925360788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d79dd1a8-cfca-49a2-8ae1-6d0a71f991f5 tempest-GroupsTest-1925360788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d79dd1a8-cfca-49a2-8ae1-6d0a71f991f5 tempest-GroupsTest-1925360788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:22 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:23:22 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:22 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-2ae3b71d-2f48-4949-894e-7c6116781ee7 tempest-GroupSnapshotsTest-2124917916 None] Group tempest-GroupSnapshotsTest-Group-1053540184: created successfully Sep 01 08:23:22 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-2ae3b71d-2f48-4949-894e-7c6116781ee7 tempest-GroupSnapshotsTest-2124917916 None] Create group completed successfully. Sep 01 08:23:22 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d79dd1a8-cfca-49a2-8ae1-6d0a71f991f5 tempest-GroupsTest-1925360788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.282s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:22 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-d79dd1a8-cfca-49a2-8ae1-6d0a71f991f5 tempest-GroupsTest-1925360788 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:23:22 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-d79dd1a8-cfca-49a2-8ae1-6d0a71f991f5 tempest-GroupsTest-1925360788 None] Delete group completed successfully. Sep 01 08:23:23 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] Flow 'volume_create_manager' (91df69e7-bc8a-4f99-a133-c71db2cbacd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (393bd8fd-3f88-4f23-917d-ce25016656c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (393bd8fd-3f88-4f23-917d-ce25016656c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-771026483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c134400-d514-4888-b540-a6171e9ae0d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24da40c7fbf348d18dd99cfac48de436',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:23:24Z,use_quota=True,user_id='5c7000eb71fb49c591c48b74e9e1ad14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9efc3b-5fce-424c-9d81-e03d44926d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9efc3b-5fce-424c-9d81-e03d44926d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b35c02a-324b-4df8-b409-8bb70e22fd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b35c02a-324b-4df8-b409-8bb70e22fd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c134400-d514-4888-b540-a6171e9ae0d2', 'volume_name': 'volume-4c134400-d514-4888-b540-a6171e9ae0d2', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438a37d1-6396-48c0-811f-e1a00936868a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438a37d1-6396-48c0-811f-e1a00936868a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b4b24a-d998-4419-8a6e-659e6aa9e604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:24 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] Volume 4c134400-d514-4888-b540-a6171e9ae0d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c134400-d514-4888-b540-a6171e9ae0d2', 'volume_size': 1} Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-771026483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c134400-d514-4888-b540-a6171e9ae0d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24da40c7fbf348d18dd99cfac48de436',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:23:24Z,use_quota=True,user_id='5c7000eb71fb49c591c48b74e9e1ad14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] Creating volume 4c134400-d514-4888-b540-a6171e9ae0d2 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:23:24 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4c134400-d514-4888-b540-a6171e9ae0d2 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:24 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4c134400-d514-4888-b540-a6171e9ae0d2 1073741824 Sep 01 08:23:24 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:24 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-8be1b90a-0e11-433e-bbc4-ca5fa9812d5d tempest-GroupsTest-1925360788 None] Group tempest-GroupsTest-Group-2008041833: creating Sep 01 08:23:24 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-8be1b90a-0e11-433e-bbc4-ca5fa9812d5d tempest-GroupsTest-1925360788 None] Group tempest-GroupsTest-Group-2008041833: created successfully Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] Flow 'volume_create_manager' (44507490-88e9-44d3-a672-92364c88f1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b829e9-bd33-483f-958a-6a7e1a6c2608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:24 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-8be1b90a-0e11-433e-bbc4-ca5fa9812d5d tempest-GroupsTest-1925360788 None] Create group completed successfully. Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b829e9-bd33-483f-958a-6a7e1a6c2608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1321740104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=73f89397-d7f2-453a-9e8c-afddeb10f620,host='devstack@QuobyteHD#QuobyteHD',id=3e372bc3-c023-4866-ad7b-8811881a6cbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='398f1e5b275b4d57924f6d60ecfb7b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:23:25Z,use_quota=True,user_id='97b2795a14024d93bdd8a1e9312459bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa9b470c-605f-46ed-811a-c48e44e70d64),volume_type_id=aa9b470c-605f-46ed-811a-c48e44e70d64)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d28ec1a-5ad0-4fb7-9386-e3a4bea10367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d28ec1a-5ad0-4fb7-9386-e3a4bea10367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cf5aae7-2516-4f3a-b38d-5c27d7a580f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cf5aae7-2516-4f3a-b38d-5c27d7a580f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e372bc3-c023-4866-ad7b-8811881a6cbc', 'volume_name': 'volume-3e372bc3-c023-4866-ad7b-8811881a6cbc', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (871bae76-665d-4e72-9fbb-2e9693145bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (871bae76-665d-4e72-9fbb-2e9693145bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19fe9d11-be8a-4820-8d44-0f28e38610c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:24 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] Volume 3e372bc3-c023-4866-ad7b-8811881a6cbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e372bc3-c023-4866-ad7b-8811881a6cbc', 'volume_size': 1} Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:24 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4c134400-d514-4888-b540-a6171e9ae0d2 1073741824" returned: 0 in 0.731s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4c134400-d514-4888-b540-a6171e9ae0d2 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:24 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4c134400-d514-4888-b540-a6171e9ae0d2 Sep 01 08:23:24 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:25 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4c134400-d514-4888-b540-a6171e9ae0d2" returned: 0 in 0.295s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:23:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.444s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=73f89397-d7f2-453a-9e8c-afddeb10f620,created_at=2026-09-01T06:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1321740104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=73f89397-d7f2-453a-9e8c-afddeb10f620,host='devstack@QuobyteHD#QuobyteHD',id=3e372bc3-c023-4866-ad7b-8811881a6cbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='398f1e5b275b4d57924f6d60ecfb7b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:23:25Z,use_quota=True,user_id='97b2795a14024d93bdd8a1e9312459bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa9b470c-605f-46ed-811a-c48e44e70d64),volume_type_id=aa9b470c-605f-46ed-811a-c48e44e70d64)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:23:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] Creating volume 3e372bc3-c023-4866-ad7b-8811881a6cbc {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:23:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:23:25 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:23:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b4b24a-d998-4419-8a6e-659e6aa9e604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c134400-d514-4888-b540-a6171e9ae0d2', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (010af406-3122-4e40-80c8-3f83a5848e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:25 devstack sudo[98336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc 1073741824 Sep 01 08:23:25 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:25 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] Volume volume-4c134400-d514-4888-b540-a6171e9ae0d2 (4c134400-d514-4888-b540-a6171e9ae0d2): created successfully Sep 01 08:23:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (010af406-3122-4e40-80c8-3f83a5848e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] Flow 'volume_create_manager' (91df69e7-bc8a-4f99-a133-c71db2cbacd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:23:25 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-4d83a548-c86c-47cf-9f99-6ff267756e21 tempest-ProjectReaderTests-104649156 None] Created volume successfully. Sep 01 08:23:25 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc 1073741824" returned: 0 in 0.637s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:25 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc Sep 01 08:23:25 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:26 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc" returned: 0 in 0.350s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19fe9d11-be8a-4820-8d44-0f28e38610c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e372bc3-c023-4866-ad7b-8811881a6cbc', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31da976f-efa2-4f50-8f1d-738e2a7b8829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:26 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] Volume volume-3e372bc3-c023-4866-ad7b-8811881a6cbc (3e372bc3-c023-4866-ad7b-8811881a6cbc): created successfully Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31da976f-efa2-4f50-8f1d-738e2a7b8829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] Flow 'volume_create_manager' (44507490-88e9-44d3-a672-92364c88f1f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] Flow 'volume_create_manager' (c2ff682c-b527-4143-8142-7f56e8c9ac6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed320319-e470-49c4-a7e5-3e36bbe35d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:26 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-69e976b0-e125-4a06-a4d0-0a431442a3b2 tempest-GroupSnapshotsTest-2124917916 None] Created volume successfully. Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed320319-e470-49c4-a7e5-3e36bbe35d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-102847434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e37ba8fb-f6de-443e-a6d0-1e327e624426,host='devstack@QuobyteHD#QuobyteHD',id=20253f07-74bc-46bd-8625-d7c988a72c08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a6120fa2ad4b6dbbc5a7b85db1bfaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:23:26Z,use_quota=True,user_id='6d861bd19e574794a2af9aa9b5fd535d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e18e76a1-35a4-410e-9c0a-1f4f8f97f1fb),volume_type_id=e18e76a1-35a4-410e-9c0a-1f4f8f97f1fb)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dfc83c4-266e-4dfe-b7d0-75b259245856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dfc83c4-266e-4dfe-b7d0-75b259245856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a768b1d6-1bf2-4523-9d81-ea368f99d7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a768b1d6-1bf2-4523-9d81-ea368f99d7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20253f07-74bc-46bd-8625-d7c988a72c08', 'volume_name': 'volume-20253f07-74bc-46bd-8625-d7c988a72c08', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b8dcef-4b51-4742-9317-21da0538f6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b8dcef-4b51-4742-9317-21da0538f6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13ee49f6-4301-42be-83f4-60600f48aab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:26 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] Volume 20253f07-74bc-46bd-8625-d7c988a72c08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20253f07-74bc-46bd-8625-d7c988a72c08', 'volume_size': 1} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e37ba8fb-f6de-443e-a6d0-1e327e624426,created_at=2026-09-01T06:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-102847434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e37ba8fb-f6de-443e-a6d0-1e327e624426,host='devstack@QuobyteHD#QuobyteHD',id=20253f07-74bc-46bd-8625-d7c988a72c08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a6120fa2ad4b6dbbc5a7b85db1bfaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:23:26Z,use_quota=True,user_id='6d861bd19e574794a2af9aa9b5fd535d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e18e76a1-35a4-410e-9c0a-1f4f8f97f1fb),volume_type_id=e18e76a1-35a4-410e-9c0a-1f4f8f97f1fb)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] Creating volume 20253f07-74bc-46bd-8625-d7c988a72c08 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:23:26 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-20253f07-74bc-46bd-8625-d7c988a72c08 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:26 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-20253f07-74bc-46bd-8625-d7c988a72c08 1073741824 Sep 01 08:23:26 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6c66647f-29ce-4d74-b96e-b077c007647d tempest-ProjectReaderTests-104649156 None] Acquiring lock "cinder-4c134400-d514-4888-b540-a6171e9ae0d2-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6c66647f-29ce-4d74-b96e-b077c007647d tempest-ProjectReaderTests-104649156 None] Lock "cinder-4c134400-d514-4888-b540-a6171e9ae0d2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6c66647f-29ce-4d74-b96e-b077c007647d tempest-ProjectReaderTests-104649156 None] Acquiring lock "cinder-quobyte-4c134400-d514-4888-b540-a6171e9ae0d2" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6c66647f-29ce-4d74-b96e-b077c007647d tempest-ProjectReaderTests-104649156 None] Lock "cinder-quobyte-4c134400-d514-4888-b540-a6171e9ae0d2" acquired by "delete_volume" :: waited 0.047s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3a0d1e-56a8-41e9-a469-1b94d95c669b]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6c66647f-29ce-4d74-b96e-b077c007647d tempest-ProjectReaderTests-104649156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4c134400-d514-4888-b540-a6171e9ae0d2 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] Flow 'volume_create_manager' (a8a6b31f-a320-4fc8-91bd-7a735bdc9bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfeef983-5f01-4133-a882-5af1fc6e0795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfeef983-5f01-4133-a882-5af1fc6e0795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1986441979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b736026e-af10-40d2-bf94-7df537c97359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20103f36d22342c296e2516bdd870513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:23:27Z,use_quota=True,user_id='2b261160ec0747439289830dc99efcb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a45e82-03e1-4032-bb7e-2789cf62a88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a45e82-03e1-4032-bb7e-2789cf62a88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e70fa9d-cf16-4c10-8bc5-485f8eda33ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e70fa9d-cf16-4c10-8bc5-485f8eda33ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b736026e-af10-40d2-bf94-7df537c97359', 'volume_name': 'volume-b736026e-af10-40d2-bf94-7df537c97359', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec96c14-2d7b-4992-a9d1-2e674ce04476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec96c14-2d7b-4992-a9d1-2e674ce04476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28889e7a-a95d-4744-9407-2914a73901a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:26 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] Volume b736026e-af10-40d2-bf94-7df537c97359: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b736026e-af10-40d2-bf94-7df537c97359', 'volume_size': 1} Sep 01 08:23:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:26 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4c134400-d514-4888-b540-a6171e9ae0d2 Sep 01 08:23:26 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:27 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-20253f07-74bc-46bd-8625-d7c988a72c08 1073741824" returned: 0 in 0.542s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-20253f07-74bc-46bd-8625-d7c988a72c08 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:27 devstack sudo[98352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-20253f07-74bc-46bd-8625-d7c988a72c08 Sep 01 08:23:27 devstack sudo[98352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:27 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6c66647f-29ce-4d74-b96e-b077c007647d tempest-ProjectReaderTests-104649156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4c134400-d514-4888-b540-a6171e9ae0d2" returned: 0 in 0.412s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6c66647f-29ce-4d74-b96e-b077c007647d tempest-ProjectReaderTests-104649156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4c134400-d514-4888-b540-a6171e9ae0d2 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:27 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4c134400-d514-4888-b540-a6171e9ae0d2 Sep 01 08:23:27 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:27 devstack sudo[98352]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-20253f07-74bc-46bd-8625-d7c988a72c08" returned: 0 in 0.306s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.476s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1986441979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b736026e-af10-40d2-bf94-7df537c97359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20103f36d22342c296e2516bdd870513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:23:27Z,use_quota=True,user_id='2b261160ec0747439289830dc99efcb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] Creating volume b736026e-af10-40d2-bf94-7df537c97359 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:23:27 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:27 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359 1073741824 Sep 01 08:23:27 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13ee49f6-4301-42be-83f4-60600f48aab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20253f07-74bc-46bd-8625-d7c988a72c08', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1632fb98-d9a9-458e-b1ee-a19bbd29f96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:27 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] Volume volume-20253f07-74bc-46bd-8625-d7c988a72c08 (20253f07-74bc-46bd-8625-d7c988a72c08): created successfully Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1632fb98-d9a9-458e-b1ee-a19bbd29f96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] Flow 'volume_create_manager' (c2ff682c-b527-4143-8142-7f56e8c9ac6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:23:27 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-1c4e0dde-413d-4ea6-9b5b-c1dfca38fba0 tempest-GroupsTest-1925360788 None] Created volume successfully. Sep 01 08:23:27 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6c66647f-29ce-4d74-b96e-b077c007647d tempest-ProjectReaderTests-104649156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4c134400-d514-4888-b540-a6171e9ae0d2" returned: 0 in 0.352s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6c66647f-29ce-4d74-b96e-b077c007647d tempest-ProjectReaderTests-104649156 None] Lock "cinder-quobyte-4c134400-d514-4888-b540-a6171e9ae0d2" released by "delete_volume" :: held 0.851s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] Flow 'volume_create_manager' (b8fb44f7-b315-48d7-9abb-d0164ca56152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc1d9cf3-2af7-4b8d-b1ef-2f095f79498b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc1d9cf3-2af7-4b8d-b1ef-2f095f79498b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1802954983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=73f89397-d7f2-453a-9e8c-afddeb10f620,host='devstack@QuobyteHD#QuobyteHD',id=c5c4370b-2c83-4691-994f-05ab87163392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='398f1e5b275b4d57924f6d60ecfb7b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:23:28Z,use_quota=True,user_id='97b2795a14024d93bdd8a1e9312459bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa9b470c-605f-46ed-811a-c48e44e70d64),volume_type_id=aa9b470c-605f-46ed-811a-c48e44e70d64)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7655575f-d96f-4169-94fb-61555794cfb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7655575f-d96f-4169-94fb-61555794cfb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6499154-0c59-4600-b9dd-c88ff372eb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6499154-0c59-4600-b9dd-c88ff372eb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5c4370b-2c83-4691-994f-05ab87163392', 'volume_name': 'volume-c5c4370b-2c83-4691-994f-05ab87163392', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6dbdd99-511e-46cf-888b-64900722757d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6dbdd99-511e-46cf-888b-64900722757d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f05a400-7969-44f0-ad6f-ab5a76b55a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:27 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] Volume c5c4370b-2c83-4691-994f-05ab87163392: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5c4370b-2c83-4691-994f-05ab87163392', 'volume_size': 1} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-6c66647f-29ce-4d74-b96e-b077c007647d tempest-ProjectReaderTests-104649156 None] Created reservations ['9bfc611b-7814-4c5f-94f6-5d67aba43946', '742d9aae-2e30-4662-a5ba-d4f39f0eb0cf', 'a64d8215-f135-440a-bb05-7a474093837d', 'cf143cc4-2802-42b5-83a1-1f55d0dccf1d'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6c66647f-29ce-4d74-b96e-b077c007647d tempest-ProjectReaderTests-104649156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6c66647f-29ce-4d74-b96e-b077c007647d tempest-ProjectReaderTests-104649156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6c66647f-29ce-4d74-b96e-b077c007647d tempest-ProjectReaderTests-104649156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6c66647f-29ce-4d74-b96e-b077c007647d tempest-ProjectReaderTests-104649156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6c66647f-29ce-4d74-b96e-b077c007647d tempest-ProjectReaderTests-104649156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6c66647f-29ce-4d74-b96e-b077c007647d tempest-ProjectReaderTests-104649156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:27 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:23:27 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:27 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359 1073741824" returned: 0 in 0.500s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:27 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359 Sep 01 08:23:27 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:28 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6c66647f-29ce-4d74-b96e-b077c007647d tempest-ProjectReaderTests-104649156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.246s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:28 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-6c66647f-29ce-4d74-b96e-b077c007647d tempest-ProjectReaderTests-104649156 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:23:28 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-6c66647f-29ce-4d74-b96e-b077c007647d tempest-ProjectReaderTests-104649156 None] Deleted volume successfully. Sep 01 08:23:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6c66647f-29ce-4d74-b96e-b077c007647d tempest-ProjectReaderTests-104649156 None] Lock "cinder-4c134400-d514-4888-b540-a6171e9ae0d2-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:28 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359" returned: 0 in 0.248s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:23:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.445s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=73f89397-d7f2-453a-9e8c-afddeb10f620,created_at=2026-09-01T06:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1802954983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=73f89397-d7f2-453a-9e8c-afddeb10f620,host='devstack@QuobyteHD#QuobyteHD',id=c5c4370b-2c83-4691-994f-05ab87163392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='398f1e5b275b4d57924f6d60ecfb7b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:23:28Z,use_quota=True,user_id='97b2795a14024d93bdd8a1e9312459bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa9b470c-605f-46ed-811a-c48e44e70d64),volume_type_id=aa9b470c-605f-46ed-811a-c48e44e70d64)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:23:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] Creating volume c5c4370b-2c83-4691-994f-05ab87163392 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:23:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:23:28 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:23:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28889e7a-a95d-4744-9407-2914a73901a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b736026e-af10-40d2-bf94-7df537c97359', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:28 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392 1073741824 Sep 01 08:23:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c14be51-be8b-4268-8212-38631541c99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:28 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:28 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] Volume volume-b736026e-af10-40d2-bf94-7df537c97359 (b736026e-af10-40d2-bf94-7df537c97359): created successfully Sep 01 08:23:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c14be51-be8b-4268-8212-38631541c99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] Flow 'volume_create_manager' (a8a6b31f-a320-4fc8-91bd-7a735bdc9bdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:23:28 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-d9d2fd73-cb8e-4961-ac7d-739f48735d70 tempest-SnapshotDependencyTests-170483109 None] Created volume successfully. Sep 01 08:23:28 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392 1073741824" returned: 0 in 0.404s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:28 devstack sudo[98380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392 Sep 01 08:23:28 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:28 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392" returned: 0 in 0.268s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:23:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f05a400-7969-44f0-ad6f-ab5a76b55a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5c4370b-2c83-4691-994f-05ab87163392', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5283bfe5-b665-4157-b1b3-990c304ea5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:28 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] Volume volume-c5c4370b-2c83-4691-994f-05ab87163392 (c5c4370b-2c83-4691-994f-05ab87163392): created successfully Sep 01 08:23:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5283bfe5-b665-4157-b1b3-990c304ea5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] Flow 'volume_create_manager' (b8fb44f7-b315-48d7-9abb-d0164ca56152) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:23:28 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-c5b83ac8-8b0c-4920-9e4d-2592dd386f71 tempest-GroupSnapshotsTest-2124917916 None] Created volume successfully. Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] Flow 'volume_create_manager' (1c67b9a9-a22b-4efd-9261-79b2f8cc6d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baad3d04-6631-4318-a337-216b1180f6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baad3d04-6631-4318-a337-216b1180f6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-940687139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e37ba8fb-f6de-443e-a6d0-1e327e624426,host='devstack@QuobyteHD#QuobyteHD',id=641a1fb8-e563-4ecf-a648-3e7fc0cf251c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a6120fa2ad4b6dbbc5a7b85db1bfaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:23:30Z,use_quota=True,user_id='6d861bd19e574794a2af9aa9b5fd535d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e18e76a1-35a4-410e-9c0a-1f4f8f97f1fb),volume_type_id=e18e76a1-35a4-410e-9c0a-1f4f8f97f1fb)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7216a058-dfe0-4b7f-94e6-cb409f3645ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7216a058-dfe0-4b7f-94e6-cb409f3645ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1befc343-2148-4e8d-bf28-b00bcc3d51f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1befc343-2148-4e8d-bf28-b00bcc3d51f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '641a1fb8-e563-4ecf-a648-3e7fc0cf251c', 'volume_name': 'volume-641a1fb8-e563-4ecf-a648-3e7fc0cf251c', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c837f9-0c1c-4800-b444-f6c24c17f8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c837f9-0c1c-4800-b444-f6c24c17f8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fd1eeb-7fd7-43b8-a43b-140a251ae83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:29 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] Volume 641a1fb8-e563-4ecf-a648-3e7fc0cf251c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-641a1fb8-e563-4ecf-a648-3e7fc0cf251c', 'volume_size': 1} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e37ba8fb-f6de-443e-a6d0-1e327e624426,created_at=2026-09-01T06:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-940687139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e37ba8fb-f6de-443e-a6d0-1e327e624426,host='devstack@QuobyteHD#QuobyteHD',id=641a1fb8-e563-4ecf-a648-3e7fc0cf251c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a6120fa2ad4b6dbbc5a7b85db1bfaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:23:30Z,use_quota=True,user_id='6d861bd19e574794a2af9aa9b5fd535d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e18e76a1-35a4-410e-9c0a-1f4f8f97f1fb),volume_type_id=e18e76a1-35a4-410e-9c0a-1f4f8f97f1fb)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] Creating volume 641a1fb8-e563-4ecf-a648-3e7fc0cf251c {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:23:29 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-641a1fb8-e563-4ecf-a648-3e7fc0cf251c 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a32a9bc2-d7b5-4582-a1a0-338a3d0bf2dd tempest-SnapshotDependencyTests-170483109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:29 devstack sudo[98385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-641a1fb8-e563-4ecf-a648-3e7fc0cf251c 1073741824 Sep 01 08:23:29 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] Flow 'volume_create_manager' (2f6515df-ce07-4765-8d23-778e603a65de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722fb26f-8ae4-459e-8faf-2e80eb9eef86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722fb26f-8ae4-459e-8faf-2e80eb9eef86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-75088620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6af5b8-79ad-4381-b300-423f47bafb8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24da40c7fbf348d18dd99cfac48de436',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:23:30Z,use_quota=True,user_id='5c7000eb71fb49c591c48b74e9e1ad14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6eb98c1-7aa2-495b-9aeb-f03cacd959a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6eb98c1-7aa2-495b-9aeb-f03cacd959a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa00049e-1a12-4ce4-bdc6-d6209b444610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa00049e-1a12-4ce4-bdc6-d6209b444610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e6af5b8-79ad-4381-b300-423f47bafb8a', 'volume_name': 'volume-0e6af5b8-79ad-4381-b300-423f47bafb8a', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39001f09-cd13-4023-9d6c-e52826073019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39001f09-cd13-4023-9d6c-e52826073019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08989b04-1158-4b06-9614-20d3b51288d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:29 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] Volume 0e6af5b8-79ad-4381-b300-423f47bafb8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e6af5b8-79ad-4381-b300-423f47bafb8a', 'volume_size': 1} Sep 01 08:23:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:30 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-1a020362-8f6f-43d5-bef4-6ca44140945f tempest-GroupSnapshotsTest-2124917916 None] Update group completed successfully. Sep 01 08:23:30 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-641a1fb8-e563-4ecf-a648-3e7fc0cf251c 1073741824" returned: 0 in 0.467s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-641a1fb8-e563-4ecf-a648-3e7fc0cf251c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:30 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-641a1fb8-e563-4ecf-a648-3e7fc0cf251c Sep 01 08:23:30 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:30 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-641a1fb8-e563-4ecf-a648-3e7fc0cf251c" returned: 0 in 0.257s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:23:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a32a9bc2-d7b5-4582-a1a0-338a3d0bf2dd tempest-SnapshotDependencyTests-170483109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.740s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-a32a9bc2-d7b5-4582-a1a0-338a3d0bf2dd tempest-SnapshotDependencyTests-170483109 None] Creating offline snapshot b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da of volume b736026e-af10-40d2-bf94-7df537c97359 {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:23:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fd1eeb-7fd7-43b8-a43b-140a251ae83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-641a1fb8-e563-4ecf-a648-3e7fc0cf251c', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6537b4d-f453-450f-a774-2b333f7ddf76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:30 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[2709ad0c-27ac-4678-af4d-6b5eb4da6465]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:23:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a32a9bc2-d7b5-4582-a1a0-338a3d0bf2dd tempest-SnapshotDependencyTests-170483109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:30 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] Volume volume-641a1fb8-e563-4ecf-a648-3e7fc0cf251c (641a1fb8-e563-4ecf-a648-3e7fc0cf251c): created successfully Sep 01 08:23:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6537b4d-f453-450f-a774-2b333f7ddf76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] Flow 'volume_create_manager' (1c67b9a9-a22b-4efd-9261-79b2f8cc6d88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:23:30 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-cd7d25f1-f848-4d03-b942-185800b2a4c2 tempest-GroupsTest-1925360788 None] Created volume successfully. Sep 01 08:23:30 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359 Sep 01 08:23:30 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:30 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a32a9bc2-d7b5-4582-a1a0-338a3d0bf2dd tempest-SnapshotDependencyTests-170483109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359" returned: 0 in 0.356s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a32a9bc2-d7b5-4582-a1a0-338a3d0bf2dd tempest-SnapshotDependencyTests-170483109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359.b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:30 devstack sudo[98399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359.b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da 1G Sep 01 08:23:30 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:23:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:31 devstack sudo[98401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:23:31 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:31 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.258s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:31 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:23:31 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-947b99b5-74a0-4d25-91a3-23dca364c4c1 tempest-GroupSnapshotsTest-2124917916 None] Update group completed successfully. Sep 01 08:23:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager._thread_info {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:23:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread count: 28 {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 08:23:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread info: [<_MainThread(MainThread, started 138934582050944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 08:23:31 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a32a9bc2-d7b5-4582-a1a0-338a3d0bf2dd tempest-SnapshotDependencyTests-170483109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359.b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da 1G" returned: 0 in 0.457s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a32a9bc2-d7b5-4582-a1a0-338a3d0bf2dd tempest-SnapshotDependencyTests-170483109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b736026e-af10-40d2-bf94-7df537c97359 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359.b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:31 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b736026e-af10-40d2-bf94-7df537c97359 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359.b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da Sep 01 08:23:31 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:31 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a32a9bc2-d7b5-4582-a1a0-338a3d0bf2dd tempest-SnapshotDependencyTests-170483109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b736026e-af10-40d2-bf94-7df537c97359 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359.b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da" returned: 0 in 0.291s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:31 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-a32a9bc2-d7b5-4582-a1a0-338a3d0bf2dd tempest-SnapshotDependencyTests-170483109 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359.b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da is being set with open permissions: ugo+rw Sep 01 08:23:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a32a9bc2-d7b5-4582-a1a0-338a3d0bf2dd tempest-SnapshotDependencyTests-170483109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359.b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:31 devstack sudo[98413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359.b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da Sep 01 08:23:31 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:31 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a32a9bc2-d7b5-4582-a1a0-338a3d0bf2dd tempest-SnapshotDependencyTests-170483109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359.b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da" returned: 0 in 0.258s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a32a9bc2-d7b5-4582-a1a0-338a3d0bf2dd tempest-SnapshotDependencyTests-170483109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:31 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-463ea25f-4e1e-45bf-b7c5-c6843b556e5e tempest-GroupsTest-1925360788 None] Update group completed successfully. Sep 01 08:23:31 devstack sudo[98416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359.info Sep 01 08:23:31 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:32 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a32a9bc2-d7b5-4582-a1a0-338a3d0bf2dd tempest-SnapshotDependencyTests-170483109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359.info" returned: 0 in 0.240s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:32 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-a32a9bc2-d7b5-4582-a1a0-338a3d0bf2dd tempest-SnapshotDependencyTests-170483109 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359.info is being set with open permissions: ugo+rw Sep 01 08:23:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a32a9bc2-d7b5-4582-a1a0-338a3d0bf2dd tempest-SnapshotDependencyTests-170483109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:32 devstack sudo[98419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359.info Sep 01 08:23:32 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:32 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a32a9bc2-d7b5-4582-a1a0-338a3d0bf2dd tempest-SnapshotDependencyTests-170483109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359.info" returned: 0 in 0.245s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a32a9bc2-d7b5-4582-a1a0-338a3d0bf2dd tempest-SnapshotDependencyTests-170483109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.953s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.593s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:32 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-75088620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6af5b8-79ad-4381-b300-423f47bafb8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24da40c7fbf348d18dd99cfac48de436',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:23:30Z,use_quota=True,user_id='5c7000eb71fb49c591c48b74e9e1ad14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:23:32 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] Creating volume 0e6af5b8-79ad-4381-b300-423f47bafb8a {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:23:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:32 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:32 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:32 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:23:32 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:23:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0e6af5b8-79ad-4381-b300-423f47bafb8a 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:32 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0e6af5b8-79ad-4381-b300-423f47bafb8a 1073741824 Sep 01 08:23:32 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:32 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-a32a9bc2-d7b5-4582-a1a0-338a3d0bf2dd tempest-SnapshotDependencyTests-170483109 None] Create snapshot completed successfully Sep 01 08:23:32 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-cb292663-9c41-49ce-abaf-217901185c1b tempest-GroupSnapshotsTest-2124917916 None] Update group completed successfully. Sep 01 08:23:32 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0e6af5b8-79ad-4381-b300-423f47bafb8a 1073741824" returned: 0 in 0.453s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0e6af5b8-79ad-4381-b300-423f47bafb8a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:33 devstack sudo[98428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0e6af5b8-79ad-4381-b300-423f47bafb8a Sep 01 08:23:33 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:23:33 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0e6af5b8-79ad-4381-b300-423f47bafb8a" returned: 0 in 0.310s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Flow 'volume_create_manager' (05086a3e-998e-4fe5-a7a3-42e8643825bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e705763-ba5c-4304-bab3-ef36723f4619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e705763-ba5c-4304-bab3-ef36723f4619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc32590e-9052-4981-95c7-1b4f2667f32f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20103f36d22342c296e2516bdd870513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:23:33Z,use_quota=True,user_id='2b261160ec0747439289830dc99efcb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d74140-c4ea-4d5d-92ed-b73fec9d6d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d74140-c4ea-4d5d-92ed-b73fec9d6d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48da71b9-4985-4186-8e02-143edaab6a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48da71b9-4985-4186-8e02-143edaab6a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fc32590e-9052-4981-95c7-1b4f2667f32f', 'volume_name': 'volume-fc32590e-9052-4981-95c7-1b4f2667f32f', 'volume_size': 1, 'snapshot_id': 'b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da'}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2482f8e5-7925-49e4-a32b-13c7b83c9fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2482f8e5-7925-49e4-a32b-13c7b83c9fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1b05b4e-e713-4ce7-b2c7-a45981dbd6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:33 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Volume fc32590e-9052-4981-95c7-1b4f2667f32f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fc32590e-9052-4981-95c7-1b4f2667f32f', 'volume_size': 1, 'snapshot_id': 'b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da'} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08989b04-1158-4b06-9614-20d3b51288d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e6af5b8-79ad-4381-b300-423f47bafb8a', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8608f2a2-484d-4b5a-8b85-223b526ee347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Acquiring lock "cinder-quobyte-b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da-fc32590e-9052-4981-95c7-1b4f2667f32f" by "_create_volume_from_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:33 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] Volume volume-0e6af5b8-79ad-4381-b300-423f47bafb8a (0e6af5b8-79ad-4381-b300-423f47bafb8a): created successfully Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8608f2a2-484d-4b5a-8b85-223b526ee347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] Flow 'volume_create_manager' (2f6515df-ce07-4765-8d23-778e603a65de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:23:33 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-b5e06f81-6342-4ade-b35d-d6dae3ada05e tempest-ProjectReaderTests-104649156 None] Created volume successfully. Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Lock "cinder-quobyte-b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da-fc32590e-9052-4981-95c7-1b4f2667f32f" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Creating volume fc32590e-9052-4981-95c7-1b4f2667f32f from snapshot b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da {{(pid=86893) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Acquiring lock "cinder-quobyte-fc32590e-9052-4981-95c7-1b4f2667f32f" by "_copy_volume_from_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Lock "cinder-quobyte-fc32590e-9052-4981-95c7-1b4f2667f32f" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] snapshot: b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da, volume: fc32590e-9052-4981-95c7-1b4f2667f32f, {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 08:23:33 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-2836374a-144a-4ea0-a2d6-80d42a9b60f2 tempest-GroupsTest-1925360788 None] Update group completed successfully. Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[16751678-b3a9-424f-a5f3-7c6882bc6fed]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359.b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:33 devstack sudo[98431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359.b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da Sep 01 08:23:33 devstack sudo[98431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:33 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-72585e74-023e-42ab-ac9c-7964c6af516b tempest-GroupSnapshotsTest-2124917916 None] Update group completed successfully. Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9cca159c-3b55-4b36-8d22-0ecd5f6aca3c tempest-ProjectReaderTests-104649156 None] Acquiring lock "cinder-0e6af5b8-79ad-4381-b300-423f47bafb8a-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9cca159c-3b55-4b36-8d22-0ecd5f6aca3c tempest-ProjectReaderTests-104649156 None] Lock "cinder-0e6af5b8-79ad-4381-b300-423f47bafb8a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9cca159c-3b55-4b36-8d22-0ecd5f6aca3c tempest-ProjectReaderTests-104649156 None] Acquiring lock "cinder-quobyte-0e6af5b8-79ad-4381-b300-423f47bafb8a" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9cca159c-3b55-4b36-8d22-0ecd5f6aca3c tempest-ProjectReaderTests-104649156 None] Lock "cinder-quobyte-0e6af5b8-79ad-4381-b300-423f47bafb8a" acquired by "delete_volume" :: waited 0.029s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[45992e12-302b-4162-87ad-40adf5ac5d85]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9cca159c-3b55-4b36-8d22-0ecd5f6aca3c tempest-ProjectReaderTests-104649156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0e6af5b8-79ad-4381-b300-423f47bafb8a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:33 devstack sudo[98431]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359.b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da" returned: 0 in 0.389s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b736026e-af10-40d2-bf94-7df537c97359(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b49c23c-0905-47d9-80b6-b705f8209259]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:23:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:33 devstack sudo[98435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0e6af5b8-79ad-4381-b300-423f47bafb8a Sep 01 08:23:33 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:34 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359 Sep 01 08:23:34 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:34 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9cca159c-3b55-4b36-8d22-0ecd5f6aca3c tempest-ProjectReaderTests-104649156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0e6af5b8-79ad-4381-b300-423f47bafb8a" returned: 0 in 0.373s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9cca159c-3b55-4b36-8d22-0ecd5f6aca3c tempest-ProjectReaderTests-104649156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0e6af5b8-79ad-4381-b300-423f47bafb8a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:34 devstack sudo[98445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0e6af5b8-79ad-4381-b300-423f47bafb8a Sep 01 08:23:34 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:34 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359" returned: 0 in 0.356s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359 {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 08:23:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Creating direct copy from snapshot {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 08:23:34 devstack cinder-volume[86893]: DEBUG cinder.utils [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Path /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fc32590e-9052-4981-95c7-1b4f2667f32f not found in is_blk_device check {{(pid=86893) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 08:23:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fc32590e-9052-4981-95c7-1b4f2667f32f {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:34 devstack sudo[98448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fc32590e-9052-4981-95c7-1b4f2667f32f Sep 01 08:23:34 devstack sudo[98448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:34 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9cca159c-3b55-4b36-8d22-0ecd5f6aca3c tempest-ProjectReaderTests-104649156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0e6af5b8-79ad-4381-b300-423f47bafb8a" returned: 0 in 0.259s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:34 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9cca159c-3b55-4b36-8d22-0ecd5f6aca3c tempest-ProjectReaderTests-104649156 None] Lock "cinder-quobyte-0e6af5b8-79ad-4381-b300-423f47bafb8a" released by "delete_volume" :: held 0.671s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:34 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-9cca159c-3b55-4b36-8d22-0ecd5f6aca3c tempest-ProjectReaderTests-104649156 None] Created reservations ['dfc30068-7d46-4781-a6af-e06e19a07b43', '1ec99598-1429-45fe-b412-9199ce04f9b6', '9d095eac-fdd5-4f5a-8614-8db65c929a9e', '0de9427e-cec8-42b3-8054-37868e0c1af7'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:23:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9cca159c-3b55-4b36-8d22-0ecd5f6aca3c tempest-ProjectReaderTests-104649156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9cca159c-3b55-4b36-8d22-0ecd5f6aca3c tempest-ProjectReaderTests-104649156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-9cca159c-3b55-4b36-8d22-0ecd5f6aca3c tempest-ProjectReaderTests-104649156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-9cca159c-3b55-4b36-8d22-0ecd5f6aca3c tempest-ProjectReaderTests-104649156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9cca159c-3b55-4b36-8d22-0ecd5f6aca3c tempest-ProjectReaderTests-104649156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9cca159c-3b55-4b36-8d22-0ecd5f6aca3c tempest-ProjectReaderTests-104649156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:34 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:23:34 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:35 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9cca159c-3b55-4b36-8d22-0ecd5f6aca3c tempest-ProjectReaderTests-104649156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.418s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:35 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-9cca159c-3b55-4b36-8d22-0ecd5f6aca3c tempest-ProjectReaderTests-104649156 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:23:35 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-9cca159c-3b55-4b36-8d22-0ecd5f6aca3c tempest-ProjectReaderTests-104649156 None] Deleted volume successfully. Sep 01 08:23:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9cca159c-3b55-4b36-8d22-0ecd5f6aca3c tempest-ProjectReaderTests-104649156 None] Lock "cinder-0e6af5b8-79ad-4381-b300-423f47bafb8a-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f8316b7e-d12e-46b9-9765-69f4d7df7616 tempest-GroupsTest-1925360788 None] Acquiring lock "cinder-quobyte-20253f07-74bc-46bd-8625-d7c988a72c08" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f8316b7e-d12e-46b9-9765-69f4d7df7616 tempest-GroupsTest-1925360788 None] Lock "cinder-quobyte-20253f07-74bc-46bd-8625-d7c988a72c08" acquired by "delete_volume" :: waited 0.046s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:35 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b184eb-9d44-418d-9cd8-0185b320d141]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:23:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f8316b7e-d12e-46b9-9765-69f4d7df7616 tempest-GroupsTest-1925360788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-20253f07-74bc-46bd-8625-d7c988a72c08 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:35 devstack sudo[98464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-20253f07-74bc-46bd-8625-d7c988a72c08 Sep 01 08:23:35 devstack sudo[98464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:36 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] GroupSnapshot b42ae264-56a1-43b8-a01b-3d93fa9a5252: creating. Sep 01 08:23:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] Group snapshot b42ae264-56a1-43b8-a01b-3d93fa9a5252: creating. {{(pid=86893) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 08:23:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:36 devstack sudo[98464]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f8316b7e-d12e-46b9-9765-69f4d7df7616 tempest-GroupsTest-1925360788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-20253f07-74bc-46bd-8625-d7c988a72c08" returned: 0 in 1.354s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f8316b7e-d12e-46b9-9765-69f4d7df7616 tempest-GroupsTest-1925360788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-20253f07-74bc-46bd-8625-d7c988a72c08 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:37 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:23:37 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-20253f07-74bc-46bd-8625-d7c988a72c08 Sep 01 08:23:37 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] Flow 'volume_create_manager' (9a21bd51-b5b0-43ca-93e9-0377faf31b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:23:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44aeb4fd-5b5a-4b81-9216-601bea53986a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44aeb4fd-5b5a-4b81-9216-601bea53986a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1670887389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cfa1c96-4c87-4301-aff3-2db8aeb58dea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24da40c7fbf348d18dd99cfac48de436',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:23:37Z,use_quota=True,user_id='5c7000eb71fb49c591c48b74e9e1ad14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (295c8e58-99d7-4946-936a-e51e8d26e3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (295c8e58-99d7-4946-936a-e51e8d26e3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a3e3532-4715-4156-a44b-0449f370b140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a3e3532-4715-4156-a44b-0449f370b140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cfa1c96-4c87-4301-aff3-2db8aeb58dea', 'volume_name': 'volume-3cfa1c96-4c87-4301-aff3-2db8aeb58dea', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1426a03-c384-4ae7-9706-a8a23709f224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1426a03-c384-4ae7-9706-a8a23709f224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0086c026-2e47-4957-99cc-081fb8de3fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:37 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] Volume 3cfa1c96-4c87-4301-aff3-2db8aeb58dea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cfa1c96-4c87-4301-aff3-2db8aeb58dea', 'volume_size': 1} Sep 01 08:23:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:37 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f8316b7e-d12e-46b9-9765-69f4d7df7616 tempest-GroupsTest-1925360788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-20253f07-74bc-46bd-8625-d7c988a72c08" returned: 0 in 0.839s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f8316b7e-d12e-46b9-9765-69f4d7df7616 tempest-GroupsTest-1925360788 None] Lock "cinder-quobyte-20253f07-74bc-46bd-8625-d7c988a72c08" released by "delete_volume" :: held 2.307s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f8316b7e-d12e-46b9-9765-69f4d7df7616 tempest-GroupsTest-1925360788 None] Acquiring lock "cinder-quobyte-641a1fb8-e563-4ecf-a648-3e7fc0cf251c" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f8316b7e-d12e-46b9-9765-69f4d7df7616 tempest-GroupsTest-1925360788 None] Lock "cinder-quobyte-641a1fb8-e563-4ecf-a648-3e7fc0cf251c" acquired by "delete_volume" :: waited 0.028s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:37 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb340ce-1cac-47ef-bd60-1950fbe17682]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:23:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f8316b7e-d12e-46b9-9765-69f4d7df7616 tempest-GroupsTest-1925360788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-641a1fb8-e563-4ecf-a648-3e7fc0cf251c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:38 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-641a1fb8-e563-4ecf-a648-3e7fc0cf251c Sep 01 08:23:38 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:38 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f8316b7e-d12e-46b9-9765-69f4d7df7616 tempest-GroupsTest-1925360788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-641a1fb8-e563-4ecf-a648-3e7fc0cf251c" returned: 0 in 0.618s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f8316b7e-d12e-46b9-9765-69f4d7df7616 tempest-GroupsTest-1925360788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-641a1fb8-e563-4ecf-a648-3e7fc0cf251c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:38 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-641a1fb8-e563-4ecf-a648-3e7fc0cf251c Sep 01 08:23:38 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:39 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f8316b7e-d12e-46b9-9765-69f4d7df7616 tempest-GroupsTest-1925360788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-641a1fb8-e563-4ecf-a648-3e7fc0cf251c" returned: 0 in 0.569s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f8316b7e-d12e-46b9-9765-69f4d7df7616 tempest-GroupsTest-1925360788 None] Lock "cinder-quobyte-641a1fb8-e563-4ecf-a648-3e7fc0cf251c" released by "delete_volume" :: held 1.283s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:39 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-f8316b7e-d12e-46b9-9765-69f4d7df7616 tempest-GroupsTest-1925360788 None] Created reservations ['1a9d4a07-4c0e-40ab-b9b2-cb22274f79dd'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:23:39 devstack cinder-volume[86893]: WARNING cinder.quota [None req-f8316b7e-d12e-46b9-9765-69f4d7df7616 tempest-GroupsTest-1925360788 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1651062870 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1651062870, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:23:39 devstack cinder-volume[86893]: WARNING cinder.quota [None req-f8316b7e-d12e-46b9-9765-69f4d7df7616 tempest-GroupsTest-1925360788 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1651062870 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1651062870, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:23:39 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-f8316b7e-d12e-46b9-9765-69f4d7df7616 tempest-GroupsTest-1925360788 None] Created reservations ['2f7677fc-9a7b-4651-9cf4-6548ae24bf46', 'cab8ec16-130e-455e-a0b4-5da2f0dcc521', '77d798cf-7ae9-49d9-907d-61f1202c3f99', '985134e1-0afe-4cd0-b23d-1155f0f740c4'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:23:39 devstack sudo[98448]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fc32590e-9052-4981-95c7-1b4f2667f32f" returned: 0 in 5.378s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:39 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Image conversion details: src /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359, size 1024.00 MB, duration 5.38 sec, destination /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fc32590e-9052-4981-95c7-1b4f2667f32f {{(pid=86893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 08:23:39 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Converted 1024.00 MB image at 190.33 MB/s Sep 01 08:23:39 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fc32590e-9052-4981-95c7-1b4f2667f32f is being set with open permissions: ugo+rw Sep 01 08:23:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fc32590e-9052-4981-95c7-1b4f2667f32f {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:39 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fc32590e-9052-4981-95c7-1b4f2667f32f Sep 01 08:23:39 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:39 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-f8316b7e-d12e-46b9-9765-69f4d7df7616 tempest-GroupsTest-1925360788 None] Created reservations ['193eef6a-9564-43cb-b0ef-602168c0ea16', '65b2b107-e0b8-4247-b7f7-01027189390e', 'dd07f117-6440-4df4-8f21-35d5878e11fd', '8fb0b1bb-0f4f-4f54-898c-2bc46fce73c8'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:23:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f8316b7e-d12e-46b9-9765-69f4d7df7616 tempest-GroupsTest-1925360788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f8316b7e-d12e-46b9-9765-69f4d7df7616 tempest-GroupsTest-1925360788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f8316b7e-d12e-46b9-9765-69f4d7df7616 tempest-GroupsTest-1925360788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f8316b7e-d12e-46b9-9765-69f4d7df7616 tempest-GroupsTest-1925360788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f8316b7e-d12e-46b9-9765-69f4d7df7616 tempest-GroupsTest-1925360788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f8316b7e-d12e-46b9-9765-69f4d7df7616 tempest-GroupsTest-1925360788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:39 devstack sudo[98484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:23:39 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:39 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fc32590e-9052-4981-95c7-1b4f2667f32f" returned: 0 in 0.256s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Lock "cinder-quobyte-fc32590e-9052-4981-95c7-1b4f2667f32f" released by "_copy_volume_from_snapshot" :: held 6.461s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Lock "cinder-quobyte-b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da-fc32590e-9052-4981-95c7-1b4f2667f32f" released by "_create_volume_from_snapshot" :: held 6.525s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.561s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.419s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] Creating offline snapshot 196b3e41-22ab-4d7c-a12e-d79a83e0de8b of volume 3e372bc3-c023-4866-ad7b-8811881a6cbc {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:23:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1b05b4e-e713-4ce7-b2c7-a45981dbd6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc32590e-9052-4981-95c7-1b4f2667f32f', 'volume_size': 1, 'snapshot_id': 'b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da'}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d66cc43-b444-4533-9cb7-fc99831c3017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:40 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[903ece1b-c34d-4d43-9f0c-7e84cd1a77b1]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:23:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:40 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Volume volume-fc32590e-9052-4981-95c7-1b4f2667f32f (fc32590e-9052-4981-95c7-1b4f2667f32f): created successfully Sep 01 08:23:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d66cc43-b444-4533-9cb7-fc99831c3017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Flow 'volume_create_manager' (05086a3e-998e-4fe5-a7a3-42e8643825bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:23:40 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-a5c793a1-707f-4cd0-8790-d9630521daee tempest-SnapshotDependencyTests-170483109 None] Created volume successfully. Sep 01 08:23:40 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f8316b7e-d12e-46b9-9765-69f4d7df7616 tempest-GroupsTest-1925360788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.264s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:40 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-f8316b7e-d12e-46b9-9765-69f4d7df7616 tempest-GroupsTest-1925360788 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:23:40 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-f8316b7e-d12e-46b9-9765-69f4d7df7616 tempest-GroupsTest-1925360788 None] Delete group completed successfully. Sep 01 08:23:40 devstack sudo[98487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc Sep 01 08:23:40 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e8c35090-8add-4a04-942b-7c9183324ea7 tempest-SnapshotDependencyTests-170483109 None] Acquiring lock "cinder-b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e8c35090-8add-4a04-942b-7c9183324ea7 tempest-SnapshotDependencyTests-170483109 None] Lock "cinder-b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e8c35090-8add-4a04-942b-7c9183324ea7 tempest-SnapshotDependencyTests-170483109 None] Acquiring lock "cinder-quobyte-b736026e-af10-40d2-bf94-7df537c97359" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e8c35090-8add-4a04-942b-7c9183324ea7 tempest-SnapshotDependencyTests-170483109 None] Lock "cinder-quobyte-b736026e-af10-40d2-bf94-7df537c97359" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e8c35090-8add-4a04-942b-7c9183324ea7 tempest-SnapshotDependencyTests-170483109 None] Acquiring lock "cinder-quobyte-b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e8c35090-8add-4a04-942b-7c9183324ea7 tempest-SnapshotDependencyTests-170483109 None] Lock "cinder-quobyte-b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:40 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-e8c35090-8add-4a04-942b-7c9183324ea7 tempest-SnapshotDependencyTests-170483109 None] Deleting offline snapshot b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da of volume b736026e-af10-40d2-bf94-7df537c97359 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:23:40 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-e8c35090-8add-4a04-942b-7c9183324ea7 tempest-SnapshotDependencyTests-170483109 None] snapshot_file for this snap is: volume-b736026e-af10-40d2-bf94-7df537c97359.b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:23:40 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bb0787-42e4-41bb-8451-b5c0ba1c07e1]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:23:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e8c35090-8add-4a04-942b-7c9183324ea7 tempest-SnapshotDependencyTests-170483109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359.b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:40 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc" returned: 0 in 0.386s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc.196b3e41-22ab-4d7c-a12e-d79a83e0de8b 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:40 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc.196b3e41-22ab-4d7c-a12e-d79a83e0de8b 1G Sep 01 08:23:40 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:40 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359.b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da Sep 01 08:23:40 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:40 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e8c35090-8add-4a04-942b-7c9183324ea7 tempest-SnapshotDependencyTests-170483109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359.b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da" returned: 0 in 0.392s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:40 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-e8c35090-8add-4a04-942b-7c9183324ea7 tempest-SnapshotDependencyTests-170483109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b736026e-af10-40d2-bf94-7df537c97359(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:23:40 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e17d3c4-55d2-44e1-884e-243731fb43c1]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:23:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e8c35090-8add-4a04-942b-7c9183324ea7 tempest-SnapshotDependencyTests-170483109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:40 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc.196b3e41-22ab-4d7c-a12e-d79a83e0de8b 1G" returned: 0 in 0.452s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e372bc3-c023-4866-ad7b-8811881a6cbc -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc.196b3e41-22ab-4d7c-a12e-d79a83e0de8b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:40 devstack sudo[98506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e372bc3-c023-4866-ad7b-8811881a6cbc -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc.196b3e41-22ab-4d7c-a12e-d79a83e0de8b Sep 01 08:23:40 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:40 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359 Sep 01 08:23:40 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:41 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e372bc3-c023-4866-ad7b-8811881a6cbc -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc.196b3e41-22ab-4d7c-a12e-d79a83e0de8b" returned: 0 in 0.335s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:41 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc.196b3e41-22ab-4d7c-a12e-d79a83e0de8b is being set with open permissions: ugo+rw: NotImplementedError Sep 01 08:23:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc.196b3e41-22ab-4d7c-a12e-d79a83e0de8b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:41 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc.196b3e41-22ab-4d7c-a12e-d79a83e0de8b Sep 01 08:23:41 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:41 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e8c35090-8add-4a04-942b-7c9183324ea7 tempest-SnapshotDependencyTests-170483109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359" returned: 0 in 0.593s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e8c35090-8add-4a04-942b-7c9183324ea7 tempest-SnapshotDependencyTests-170483109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359.b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:41 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359.b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da Sep 01 08:23:41 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:41 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc.196b3e41-22ab-4d7c-a12e-d79a83e0de8b" returned: 0 in 0.259s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:41 devstack sudo[98521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc.info Sep 01 08:23:41 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:41 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc.info" returned: 0 in 0.264s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:41 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 08:23:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:41 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e8c35090-8add-4a04-942b-7c9183324ea7 tempest-SnapshotDependencyTests-170483109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359.b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da" returned: 0 in 0.367s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e8c35090-8add-4a04-942b-7c9183324ea7 tempest-SnapshotDependencyTests-170483109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359.b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:41 devstack sudo[98527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc.info Sep 01 08:23:41 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:41 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359.b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da Sep 01 08:23:41 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:42 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc.info" returned: 0 in 0.271s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.075s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] Creating offline snapshot 7a88e352-d72d-4d13-a59d-37d3131e91c3 of volume c5c4370b-2c83-4691-994f-05ab87163392 {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:23:42 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e8c35090-8add-4a04-942b-7c9183324ea7 tempest-SnapshotDependencyTests-170483109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359.b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da" returned: 0 in 0.302s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:42 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b560111-32c5-4eae-a0ca-3cb38a615d06]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:23:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e8c35090-8add-4a04-942b-7c9183324ea7 tempest-SnapshotDependencyTests-170483109 None] Lock "cinder-quobyte-b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da" released by "_delete_snapshot" :: held 1.770s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e8c35090-8add-4a04-942b-7c9183324ea7 tempest-SnapshotDependencyTests-170483109 None] Lock "cinder-quobyte-b736026e-af10-40d2-bf94-7df537c97359" released by "delete_snapshot" :: held 1.801s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:42 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-e8c35090-8add-4a04-942b-7c9183324ea7 tempest-SnapshotDependencyTests-170483109 None] Created reservations ['0faadb4f-3904-4253-a9bc-5138c7e86be1', '10bb8bf3-d4ab-4dbc-a7fd-54fc16e62010', '252564a7-d8a7-43e5-ac56-c8ec5857036f', '91fb7886-342f-4cd0-a43b-458bcebac43a'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:23:42 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392 Sep 01 08:23:42 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:42 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-e8c35090-8add-4a04-942b-7c9183324ea7 tempest-SnapshotDependencyTests-170483109 None] Delete snapshot completed successfully. Sep 01 08:23:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e8c35090-8add-4a04-942b-7c9183324ea7 tempest-SnapshotDependencyTests-170483109 None] Lock "cinder-b85bf17f-9a4f-4ea9-86f9-3bcc7e95e8da-delete_snapshot" released by "delete_snapshot" :: held 1.957s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2de7ee13-68d4-445d-a467-c8acfb2acd18 tempest-SnapshotDependencyTests-170483109 None] Acquiring lock "cinder-b736026e-af10-40d2-bf94-7df537c97359-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2de7ee13-68d4-445d-a467-c8acfb2acd18 tempest-SnapshotDependencyTests-170483109 None] Lock "cinder-b736026e-af10-40d2-bf94-7df537c97359-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:42 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2de7ee13-68d4-445d-a467-c8acfb2acd18 tempest-SnapshotDependencyTests-170483109 None] Acquiring lock "cinder-quobyte-b736026e-af10-40d2-bf94-7df537c97359" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392" returned: 0 in 0.444s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392.7a88e352-d72d-4d13-a59d-37d3131e91c3 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2de7ee13-68d4-445d-a467-c8acfb2acd18 tempest-SnapshotDependencyTests-170483109 None] Lock "cinder-quobyte-b736026e-af10-40d2-bf94-7df537c97359" acquired by "delete_volume" :: waited 0.032s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:42 devstack sudo[98539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392.7a88e352-d72d-4d13-a59d-37d3131e91c3 1G Sep 01 08:23:42 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:42 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4c663e-57d2-4b60-a9f3-2c1464161998]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:23:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2de7ee13-68d4-445d-a467-c8acfb2acd18 tempest-SnapshotDependencyTests-170483109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:42 devstack sudo[98541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359 Sep 01 08:23:42 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:43 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:43 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392.7a88e352-d72d-4d13-a59d-37d3131e91c3 1G" returned: 0 in 0.482s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5c4370b-2c83-4691-994f-05ab87163392 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392.7a88e352-d72d-4d13-a59d-37d3131e91c3 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2de7ee13-68d4-445d-a467-c8acfb2acd18 tempest-SnapshotDependencyTests-170483109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359" returned: 0 in 0.421s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2de7ee13-68d4-445d-a467-c8acfb2acd18 tempest-SnapshotDependencyTests-170483109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:43 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5c4370b-2c83-4691-994f-05ab87163392 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392.7a88e352-d72d-4d13-a59d-37d3131e91c3 Sep 01 08:23:43 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:43 devstack sudo[98551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359 Sep 01 08:23:43 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:43 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2de7ee13-68d4-445d-a467-c8acfb2acd18 tempest-SnapshotDependencyTests-170483109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-b736026e-af10-40d2-bf94-7df537c97359" returned: 0 in 0.298s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:43 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2de7ee13-68d4-445d-a467-c8acfb2acd18 tempest-SnapshotDependencyTests-170483109 None] Lock "cinder-quobyte-b736026e-af10-40d2-bf94-7df537c97359" released by "delete_volume" :: held 0.793s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:43 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5c4370b-2c83-4691-994f-05ab87163392 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392.7a88e352-d72d-4d13-a59d-37d3131e91c3" returned: 0 in 0.357s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:43 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392.7a88e352-d72d-4d13-a59d-37d3131e91c3 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 08:23:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392.7a88e352-d72d-4d13-a59d-37d3131e91c3 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:43 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392.7a88e352-d72d-4d13-a59d-37d3131e91c3 Sep 01 08:23:43 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:43 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-2de7ee13-68d4-445d-a467-c8acfb2acd18 tempest-SnapshotDependencyTests-170483109 None] Created reservations ['dff754a6-c237-46ed-92bd-61338c3eae8a', 'c82ee9e7-e991-4115-beaf-4e7e1e3e9bc8', '0a92f633-e1fb-4e37-9d38-2c630bc0c08e', '28691545-434f-4ed0-b72b-409890b5687f'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:23:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2de7ee13-68d4-445d-a467-c8acfb2acd18 tempest-SnapshotDependencyTests-170483109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2de7ee13-68d4-445d-a467-c8acfb2acd18 tempest-SnapshotDependencyTests-170483109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:43 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2de7ee13-68d4-445d-a467-c8acfb2acd18 tempest-SnapshotDependencyTests-170483109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:43 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2de7ee13-68d4-445d-a467-c8acfb2acd18 tempest-SnapshotDependencyTests-170483109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2de7ee13-68d4-445d-a467-c8acfb2acd18 tempest-SnapshotDependencyTests-170483109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2de7ee13-68d4-445d-a467-c8acfb2acd18 tempest-SnapshotDependencyTests-170483109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:43 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:23:43 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:43 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392.7a88e352-d72d-4d13-a59d-37d3131e91c3" returned: 0 in 0.293s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:43 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-627c5fa0-0f6d-4ac0-b0c4-91aa2efb564a tempest-SnapshotDependencyTests-170483109 None] Acquiring lock "cinder-fc32590e-9052-4981-95c7-1b4f2667f32f-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:43 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-627c5fa0-0f6d-4ac0-b0c4-91aa2efb564a tempest-SnapshotDependencyTests-170483109 None] Lock "cinder-fc32590e-9052-4981-95c7-1b4f2667f32f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:43 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392.info Sep 01 08:23:43 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:43 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-627c5fa0-0f6d-4ac0-b0c4-91aa2efb564a tempest-SnapshotDependencyTests-170483109 None] Acquiring lock "cinder-quobyte-fc32590e-9052-4981-95c7-1b4f2667f32f" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:43 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2de7ee13-68d4-445d-a467-c8acfb2acd18 tempest-SnapshotDependencyTests-170483109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.282s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:43 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-2de7ee13-68d4-445d-a467-c8acfb2acd18 tempest-SnapshotDependencyTests-170483109 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:23:43 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-2de7ee13-68d4-445d-a467-c8acfb2acd18 tempest-SnapshotDependencyTests-170483109 None] Deleted volume successfully. Sep 01 08:23:43 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-627c5fa0-0f6d-4ac0-b0c4-91aa2efb564a tempest-SnapshotDependencyTests-170483109 None] Lock "cinder-quobyte-fc32590e-9052-4981-95c7-1b4f2667f32f" acquired by "delete_volume" :: waited 0.025s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:43 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf76f5df-9897-45bf-b5ec-3a2735e5a628]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:23:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-627c5fa0-0f6d-4ac0-b0c4-91aa2efb564a tempest-SnapshotDependencyTests-170483109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fc32590e-9052-4981-95c7-1b4f2667f32f {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:43 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2de7ee13-68d4-445d-a467-c8acfb2acd18 tempest-SnapshotDependencyTests-170483109 None] Lock "cinder-b736026e-af10-40d2-bf94-7df537c97359-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:43 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fc32590e-9052-4981-95c7-1b4f2667f32f Sep 01 08:23:43 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:44 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392.info" returned: 0 in 0.314s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:44 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 08:23:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:44 devstack sudo[98569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392.info Sep 01 08:23:44 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:44 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-627c5fa0-0f6d-4ac0-b0c4-91aa2efb564a tempest-SnapshotDependencyTests-170483109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fc32590e-9052-4981-95c7-1b4f2667f32f" returned: 0 in 0.403s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-627c5fa0-0f6d-4ac0-b0c4-91aa2efb564a tempest-SnapshotDependencyTests-170483109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fc32590e-9052-4981-95c7-1b4f2667f32f {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:44 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fc32590e-9052-4981-95c7-1b4f2667f32f Sep 01 08:23:44 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:44 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392.info" returned: 0 in 0.268s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.292s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.099s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:44 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1670887389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cfa1c96-4c87-4301-aff3-2db8aeb58dea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24da40c7fbf348d18dd99cfac48de436',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:23:37Z,use_quota=True,user_id='5c7000eb71fb49c591c48b74e9e1ad14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:23:44 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] Creating volume 3cfa1c96-4c87-4301-aff3-2db8aeb58dea {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:23:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:44 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:44 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:44 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:23:44 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:23:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3cfa1c96-4c87-4301-aff3-2db8aeb58dea 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:44 devstack sudo[98577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3cfa1c96-4c87-4301-aff3-2db8aeb58dea 1073741824 Sep 01 08:23:44 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:44 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-4fbb34db-bd56-4f78-af55-f816b9465112 tempest-GroupSnapshotsTest-2124917916 None] group_snapshot b42ae264-56a1-43b8-a01b-3d93fa9a5252: created successfully Sep 01 08:23:44 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-627c5fa0-0f6d-4ac0-b0c4-91aa2efb564a tempest-SnapshotDependencyTests-170483109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fc32590e-9052-4981-95c7-1b4f2667f32f" returned: 0 in 0.294s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:44 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-627c5fa0-0f6d-4ac0-b0c4-91aa2efb564a tempest-SnapshotDependencyTests-170483109 None] Lock "cinder-quobyte-fc32590e-9052-4981-95c7-1b4f2667f32f" released by "delete_volume" :: held 0.750s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:44 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-627c5fa0-0f6d-4ac0-b0c4-91aa2efb564a tempest-SnapshotDependencyTests-170483109 None] Created reservations ['0926c938-64ad-4502-885e-5e536ca4e401', 'c5b85c62-6cf9-40e3-a4a6-d0ce59af3bc8', 'd403c3e8-42a1-45bb-8e32-8e7a2e8298bb', '9c8400f4-46b0-41eb-a246-24cf8efb6751'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:23:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-627c5fa0-0f6d-4ac0-b0c4-91aa2efb564a tempest-SnapshotDependencyTests-170483109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-627c5fa0-0f6d-4ac0-b0c4-91aa2efb564a tempest-SnapshotDependencyTests-170483109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:44 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-627c5fa0-0f6d-4ac0-b0c4-91aa2efb564a tempest-SnapshotDependencyTests-170483109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:44 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-627c5fa0-0f6d-4ac0-b0c4-91aa2efb564a tempest-SnapshotDependencyTests-170483109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-627c5fa0-0f6d-4ac0-b0c4-91aa2efb564a tempest-SnapshotDependencyTests-170483109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-627c5fa0-0f6d-4ac0-b0c4-91aa2efb564a tempest-SnapshotDependencyTests-170483109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:44 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:23:44 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:44 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3cfa1c96-4c87-4301-aff3-2db8aeb58dea 1073741824" returned: 0 in 0.588s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3cfa1c96-4c87-4301-aff3-2db8aeb58dea {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:45 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-627c5fa0-0f6d-4ac0-b0c4-91aa2efb564a tempest-SnapshotDependencyTests-170483109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.333s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:45 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-627c5fa0-0f6d-4ac0-b0c4-91aa2efb564a tempest-SnapshotDependencyTests-170483109 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:23:45 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-627c5fa0-0f6d-4ac0-b0c4-91aa2efb564a tempest-SnapshotDependencyTests-170483109 None] Deleted volume successfully. Sep 01 08:23:45 devstack sudo[98588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3cfa1c96-4c87-4301-aff3-2db8aeb58dea Sep 01 08:23:45 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:45 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-627c5fa0-0f6d-4ac0-b0c4-91aa2efb564a tempest-SnapshotDependencyTests-170483109 None] Lock "cinder-fc32590e-9052-4981-95c7-1b4f2667f32f-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:45 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3cfa1c96-4c87-4301-aff3-2db8aeb58dea" returned: 0 in 0.317s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:45 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:23:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0086c026-2e47-4957-99cc-081fb8de3fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cfa1c96-4c87-4301-aff3-2db8aeb58dea', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cddf212-989d-46b9-899a-04999fd67f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:45 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] Volume volume-3cfa1c96-4c87-4301-aff3-2db8aeb58dea (3cfa1c96-4c87-4301-aff3-2db8aeb58dea): created successfully Sep 01 08:23:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cddf212-989d-46b9-899a-04999fd67f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] Flow 'volume_create_manager' (9a21bd51-b5b0-43ca-93e9-0377faf31b82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:23:45 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] group_snapshot b42ae264-56a1-43b8-a01b-3d93fa9a5252: deleting Sep 01 08:23:45 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-73a97d1d-9e6e-4de5-bdfd-4642fd0a2e1b tempest-ProjectReaderTests-104649156 None] Created volume successfully. Sep 01 08:23:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] group_snapshot b42ae264-56a1-43b8-a01b-3d93fa9a5252: deleting {{(pid=86893) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 08:23:45 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "cinder-quobyte-3e372bc3-c023-4866-ad7b-8811881a6cbc" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:45 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] Lock "cinder-quobyte-3e372bc3-c023-4866-ad7b-8811881a6cbc" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:45 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "cinder-quobyte-196b3e41-22ab-4d7c-a12e-d79a83e0de8b" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:45 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] Lock "cinder-quobyte-196b3e41-22ab-4d7c-a12e-d79a83e0de8b" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:45 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] Deleting offline snapshot 196b3e41-22ab-4d7c-a12e-d79a83e0de8b of volume 3e372bc3-c023-4866-ad7b-8811881a6cbc {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:23:45 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] snapshot_file for this snap is: volume-3e372bc3-c023-4866-ad7b-8811881a6cbc.196b3e41-22ab-4d7c-a12e-d79a83e0de8b {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:23:45 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c41eeb-98e5-419a-8430-00d00bfd9a07]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:23:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc.196b3e41-22ab-4d7c-a12e-d79a83e0de8b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:45 devstack sudo[98591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc.196b3e41-22ab-4d7c-a12e-d79a83e0de8b Sep 01 08:23:45 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:46 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc.196b3e41-22ab-4d7c-a12e-d79a83e0de8b" returned: 0 in 0.461s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e372bc3-c023-4866-ad7b-8811881a6cbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:23:46 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d120620-c43a-4fee-912b-03d1c07ad99a]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:23:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:46 devstack sudo[98596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc Sep 01 08:23:46 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:46 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-6850ae71-7170-4158-a3d4-66c1a9f53c68 tempest-GroupsV320Test-2096616251 None] Group tempest-GroupsV320Test-Group-339331957: creating Sep 01 08:23:46 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-6850ae71-7170-4158-a3d4-66c1a9f53c68 tempest-GroupsV320Test-2096616251 None] Group tempest-GroupsV320Test-Group-339331957: created successfully Sep 01 08:23:46 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-6850ae71-7170-4158-a3d4-66c1a9f53c68 tempest-GroupsV320Test-2096616251 None] Create group completed successfully. Sep 01 08:23:46 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc" returned: 0 in 0.398s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc.196b3e41-22ab-4d7c-a12e-d79a83e0de8b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:46 devstack sudo[98601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc.196b3e41-22ab-4d7c-a12e-d79a83e0de8b Sep 01 08:23:46 devstack sudo[98601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:46 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7f653f08-3a22-495a-bad2-c1bf650bcefd tempest-ProjectReaderTests-104649156 None] Acquiring lock "cinder-3cfa1c96-4c87-4301-aff3-2db8aeb58dea-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:46 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7f653f08-3a22-495a-bad2-c1bf650bcefd tempest-ProjectReaderTests-104649156 None] Lock "cinder-3cfa1c96-4c87-4301-aff3-2db8aeb58dea-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:46 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7f653f08-3a22-495a-bad2-c1bf650bcefd tempest-ProjectReaderTests-104649156 None] Acquiring lock "cinder-quobyte-3cfa1c96-4c87-4301-aff3-2db8aeb58dea" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:46 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7f653f08-3a22-495a-bad2-c1bf650bcefd tempest-ProjectReaderTests-104649156 None] Lock "cinder-quobyte-3cfa1c96-4c87-4301-aff3-2db8aeb58dea" acquired by "delete_volume" :: waited 0.019s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:46 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3524f6-ac9e-4bfd-9ec7-937ff5c1a294]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:23:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7f653f08-3a22-495a-bad2-c1bf650bcefd tempest-ProjectReaderTests-104649156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3cfa1c96-4c87-4301-aff3-2db8aeb58dea {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:46 devstack sudo[98601]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc.196b3e41-22ab-4d7c-a12e-d79a83e0de8b" returned: 0 in 0.394s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc.196b3e41-22ab-4d7c-a12e-d79a83e0de8b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:46 devstack sudo[98607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3cfa1c96-4c87-4301-aff3-2db8aeb58dea Sep 01 08:23:46 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:46 devstack sudo[98608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc.196b3e41-22ab-4d7c-a12e-d79a83e0de8b Sep 01 08:23:46 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:47 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc.196b3e41-22ab-4d7c-a12e-d79a83e0de8b" returned: 0 in 0.254s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:47 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] Lock "cinder-quobyte-196b3e41-22ab-4d7c-a12e-d79a83e0de8b" released by "_delete_snapshot" :: held 1.618s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:47 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:47 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] Lock "cinder-quobyte-3e372bc3-c023-4866-ad7b-8811881a6cbc" released by "delete_snapshot" :: held 1.656s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7f653f08-3a22-495a-bad2-c1bf650bcefd tempest-ProjectReaderTests-104649156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3cfa1c96-4c87-4301-aff3-2db8aeb58dea" returned: 0 in 0.414s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7f653f08-3a22-495a-bad2-c1bf650bcefd tempest-ProjectReaderTests-104649156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3cfa1c96-4c87-4301-aff3-2db8aeb58dea {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:47 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "cinder-quobyte-c5c4370b-2c83-4691-994f-05ab87163392" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:47 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3cfa1c96-4c87-4301-aff3-2db8aeb58dea Sep 01 08:23:47 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] Lock "cinder-quobyte-c5c4370b-2c83-4691-994f-05ab87163392" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:47 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "cinder-quobyte-7a88e352-d72d-4d13-a59d-37d3131e91c3" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:47 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:47 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] Lock "cinder-quobyte-7a88e352-d72d-4d13-a59d-37d3131e91c3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] Deleting offline snapshot 7a88e352-d72d-4d13-a59d-37d3131e91c3 of volume c5c4370b-2c83-4691-994f-05ab87163392 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:23:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] snapshot_file for this snap is: volume-c5c4370b-2c83-4691-994f-05ab87163392.7a88e352-d72d-4d13-a59d-37d3131e91c3 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:23:47 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c486f9-fbee-4244-9d9a-c5ce68e377b1]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:23:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392.7a88e352-d72d-4d13-a59d-37d3131e91c3 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:47 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392.7a88e352-d72d-4d13-a59d-37d3131e91c3 Sep 01 08:23:47 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:47 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7f653f08-3a22-495a-bad2-c1bf650bcefd tempest-ProjectReaderTests-104649156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3cfa1c96-4c87-4301-aff3-2db8aeb58dea" returned: 0 in 0.325s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:47 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7f653f08-3a22-495a-bad2-c1bf650bcefd tempest-ProjectReaderTests-104649156 None] Lock "cinder-quobyte-3cfa1c96-4c87-4301-aff3-2db8aeb58dea" released by "delete_volume" :: held 0.789s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:47 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-7f653f08-3a22-495a-bad2-c1bf650bcefd tempest-ProjectReaderTests-104649156 None] Created reservations ['5b236222-8405-4031-ae0b-2101bbfc0aa9', 'f8ef20d2-67ee-4e88-ba3b-271b45e879fd', 'b21c07df-34be-4bc2-be11-7ef0d4e78b4e', '036db4c7-dab7-4046-b4ec-cbacedf74e7a'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:23:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7f653f08-3a22-495a-bad2-c1bf650bcefd tempest-ProjectReaderTests-104649156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7f653f08-3a22-495a-bad2-c1bf650bcefd tempest-ProjectReaderTests-104649156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7f653f08-3a22-495a-bad2-c1bf650bcefd tempest-ProjectReaderTests-104649156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7f653f08-3a22-495a-bad2-c1bf650bcefd tempest-ProjectReaderTests-104649156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7f653f08-3a22-495a-bad2-c1bf650bcefd tempest-ProjectReaderTests-104649156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7f653f08-3a22-495a-bad2-c1bf650bcefd tempest-ProjectReaderTests-104649156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:47 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:23:47 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:47 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392.7a88e352-d72d-4d13-a59d-37d3131e91c3" returned: 0 in 0.557s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5c4370b-2c83-4691-994f-05ab87163392(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:23:47 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ce5e3a-ce3e-4c5a-ac2d-43e6df4d8b9f]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:23:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:47 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-0350043a-cd17-449c-b8f9-da377cbda2db tempest-GroupsV320Test-2096616251 None] Created reservations ['80c6f3d6-bc90-440f-9d75-b61ad20bff02'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:23:48 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392 Sep 01 08:23:48 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:48 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7f653f08-3a22-495a-bad2-c1bf650bcefd tempest-ProjectReaderTests-104649156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.383s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-7f653f08-3a22-495a-bad2-c1bf650bcefd tempest-ProjectReaderTests-104649156 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:23:48 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-7f653f08-3a22-495a-bad2-c1bf650bcefd tempest-ProjectReaderTests-104649156 None] Deleted volume successfully. Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0350043a-cd17-449c-b8f9-da377cbda2db tempest-GroupsV320Test-2096616251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0350043a-cd17-449c-b8f9-da377cbda2db tempest-GroupsV320Test-2096616251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0350043a-cd17-449c-b8f9-da377cbda2db tempest-GroupsV320Test-2096616251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0350043a-cd17-449c-b8f9-da377cbda2db tempest-GroupsV320Test-2096616251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0350043a-cd17-449c-b8f9-da377cbda2db tempest-GroupsV320Test-2096616251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0350043a-cd17-449c-b8f9-da377cbda2db tempest-GroupsV320Test-2096616251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7f653f08-3a22-495a-bad2-c1bf650bcefd tempest-ProjectReaderTests-104649156 None] Lock "cinder-3cfa1c96-4c87-4301-aff3-2db8aeb58dea-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:48 devstack sudo[98629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:23:48 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:23:48 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] Flow 'volume_create_manager' (a7c789c0-7d7b-4645-9633-43425a50c613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3364ecce-8d86-47ba-9751-62cc36d18d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392" returned: 0 in 0.488s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392.7a88e352-d72d-4d13-a59d-37d3131e91c3 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:48 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3364ecce-8d86-47ba-9751-62cc36d18d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2116095420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e6bda4f-1b4c-4405-93b5-03f8dcfd31f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24da40c7fbf348d18dd99cfac48de436',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:23:48Z,use_quota=True,user_id='5c7000eb71fb49c591c48b74e9e1ad14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cb88cf5-aeea-4470-b742-181c04efc101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:48 devstack sudo[98635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392.7a88e352-d72d-4d13-a59d-37d3131e91c3 Sep 01 08:23:48 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cb88cf5-aeea-4470-b742-181c04efc101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5675de68-075d-4646-b9a4-e94b95917376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5675de68-075d-4646-b9a4-e94b95917376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e6bda4f-1b4c-4405-93b5-03f8dcfd31f0', 'volume_name': 'volume-1e6bda4f-1b4c-4405-93b5-03f8dcfd31f0', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c792da39-fc7b-4e1f-8fca-fdcb568c916a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c792da39-fc7b-4e1f-8fca-fdcb568c916a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe20a4d-1943-48fc-bfd9-a44f3cf2bf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:48 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] Volume 1e6bda4f-1b4c-4405-93b5-03f8dcfd31f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e6bda4f-1b4c-4405-93b5-03f8dcfd31f0', 'volume_size': 1} Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2116095420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e6bda4f-1b4c-4405-93b5-03f8dcfd31f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24da40c7fbf348d18dd99cfac48de436',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:23:48Z,use_quota=True,user_id='5c7000eb71fb49c591c48b74e9e1ad14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] Creating volume 1e6bda4f-1b4c-4405-93b5-03f8dcfd31f0 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:23:48 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1e6bda4f-1b4c-4405-93b5-03f8dcfd31f0 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0350043a-cd17-449c-b8f9-da377cbda2db tempest-GroupsV320Test-2096616251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.351s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-0350043a-cd17-449c-b8f9-da377cbda2db tempest-GroupsV320Test-2096616251 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:23:48 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-0350043a-cd17-449c-b8f9-da377cbda2db tempest-GroupsV320Test-2096616251 None] Delete group completed successfully. Sep 01 08:23:48 devstack sudo[98637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1e6bda4f-1b4c-4405-93b5-03f8dcfd31f0 1073741824 Sep 01 08:23:48 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:48 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392.7a88e352-d72d-4d13-a59d-37d3131e91c3" returned: 0 in 0.376s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392.7a88e352-d72d-4d13-a59d-37d3131e91c3 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:48 devstack sudo[98645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392.7a88e352-d72d-4d13-a59d-37d3131e91c3 Sep 01 08:23:48 devstack sudo[98645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:49 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1e6bda4f-1b4c-4405-93b5-03f8dcfd31f0 1073741824" returned: 0 in 0.567s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:49 devstack sudo[98645]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392.7a88e352-d72d-4d13-a59d-37d3131e91c3" returned: 0 in 0.307s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1e6bda4f-1b4c-4405-93b5-03f8dcfd31f0 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:49 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] Lock "cinder-quobyte-7a88e352-d72d-4d13-a59d-37d3131e91c3" released by "_delete_snapshot" :: held 1.883s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:49 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] Lock "cinder-quobyte-c5c4370b-2c83-4691-994f-05ab87163392" released by "delete_snapshot" :: held 1.916s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:49 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1e6bda4f-1b4c-4405-93b5-03f8dcfd31f0 Sep 01 08:23:49 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:49 devstack cinder-volume[86893]: WARNING cinder.quota [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-697864892 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-697864892, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:23:49 devstack cinder-volume[86893]: WARNING cinder.quota [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-697864892 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-697864892, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:23:49 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] Created reservations ['b472b091-0e56-4220-ad6a-9251f169e0e8', '8b832a40-c620-462b-ab71-65eb7aabbee5', 'b1b9e69c-5596-42a6-a8ec-dbf3bd13e4b3', '1269f2c0-91ec-4be5-8bed-71c206b8f4cb'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:23:49 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] Created reservations ['e97f1a82-0428-4081-a9d0-71a231610c78', '333d5129-043e-45e8-b3b9-3d26122a7d48', '1d841eba-21eb-4123-a6c6-c4c557b39e68', '9b15f874-2387-4288-87cf-557acfff25a5'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:23:49 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1e6bda4f-1b4c-4405-93b5-03f8dcfd31f0" returned: 0 in 0.340s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:49 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:23:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe20a4d-1943-48fc-bfd9-a44f3cf2bf0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e6bda4f-1b4c-4405-93b5-03f8dcfd31f0', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa17291-7e10-4a46-a4d3-9083dca957c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:49 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] Volume volume-1e6bda4f-1b4c-4405-93b5-03f8dcfd31f0 (1e6bda4f-1b4c-4405-93b5-03f8dcfd31f0): created successfully Sep 01 08:23:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa17291-7e10-4a46-a4d3-9083dca957c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] Flow 'volume_create_manager' (a7c789c0-7d7b-4645-9633-43425a50c613) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:23:49 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-0a8e75f1-e95f-439b-9b43-52839c69c901 tempest-ProjectReaderTests-104649156 None] Created volume successfully. Sep 01 08:23:49 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-2eebc14f-0039-4161-9913-33b42d14e903 tempest-GroupSnapshotsTest-2124917916 None] group_snapshot b42ae264-56a1-43b8-a01b-3d93fa9a5252: deleted successfully Sep 01 08:23:50 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-87a77bdc-84ef-4604-b83e-b042a1154ad2 tempest-ProjectReaderTests-104649156 None] Acquiring lock "cinder-1e6bda4f-1b4c-4405-93b5-03f8dcfd31f0-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:50 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7c483b6f-fb11-4b0b-8270-598e6d9b19e1 tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "cinder-quobyte-3e372bc3-c023-4866-ad7b-8811881a6cbc" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:50 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-87a77bdc-84ef-4604-b83e-b042a1154ad2 tempest-ProjectReaderTests-104649156 None] Lock "cinder-1e6bda4f-1b4c-4405-93b5-03f8dcfd31f0-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:50 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7c483b6f-fb11-4b0b-8270-598e6d9b19e1 tempest-GroupSnapshotsTest-2124917916 None] Lock "cinder-quobyte-3e372bc3-c023-4866-ad7b-8811881a6cbc" acquired by "delete_volume" :: waited 0.054s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:50 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcafa66-db25-4319-b419-4895f7bf6e98]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:23:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7c483b6f-fb11-4b0b-8270-598e6d9b19e1 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:50 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-87a77bdc-84ef-4604-b83e-b042a1154ad2 tempest-ProjectReaderTests-104649156 None] Acquiring lock "cinder-quobyte-1e6bda4f-1b4c-4405-93b5-03f8dcfd31f0" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:50 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-87a77bdc-84ef-4604-b83e-b042a1154ad2 tempest-ProjectReaderTests-104649156 None] Lock "cinder-quobyte-1e6bda4f-1b4c-4405-93b5-03f8dcfd31f0" acquired by "delete_volume" :: waited 0.036s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:50 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae1e46a-da90-4818-a545-1804f603b33a]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:23:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-87a77bdc-84ef-4604-b83e-b042a1154ad2 tempest-ProjectReaderTests-104649156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1e6bda4f-1b4c-4405-93b5-03f8dcfd31f0 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:50 devstack sudo[98653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc Sep 01 08:23:50 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:50 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1e6bda4f-1b4c-4405-93b5-03f8dcfd31f0 Sep 01 08:23:50 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:51 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7c483b6f-fb11-4b0b-8270-598e6d9b19e1 tempest-GroupSnapshotsTest-2124917916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc" returned: 0 in 0.513s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7c483b6f-fb11-4b0b-8270-598e6d9b19e1 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:51 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc Sep 01 08:23:51 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:51 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-87a77bdc-84ef-4604-b83e-b042a1154ad2 tempest-ProjectReaderTests-104649156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1e6bda4f-1b4c-4405-93b5-03f8dcfd31f0" returned: 0 in 0.474s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-87a77bdc-84ef-4604-b83e-b042a1154ad2 tempest-ProjectReaderTests-104649156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1e6bda4f-1b4c-4405-93b5-03f8dcfd31f0 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:51 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1e6bda4f-1b4c-4405-93b5-03f8dcfd31f0 Sep 01 08:23:51 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:51 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7c483b6f-fb11-4b0b-8270-598e6d9b19e1 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-3e372bc3-c023-4866-ad7b-8811881a6cbc" returned: 0 in 0.299s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:51 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7c483b6f-fb11-4b0b-8270-598e6d9b19e1 tempest-GroupSnapshotsTest-2124917916 None] Lock "cinder-quobyte-3e372bc3-c023-4866-ad7b-8811881a6cbc" released by "delete_volume" :: held 0.905s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:51 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7c483b6f-fb11-4b0b-8270-598e6d9b19e1 tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "cinder-quobyte-c5c4370b-2c83-4691-994f-05ab87163392" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:23:51 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7c483b6f-fb11-4b0b-8270-598e6d9b19e1 tempest-GroupSnapshotsTest-2124917916 None] Lock "cinder-quobyte-c5c4370b-2c83-4691-994f-05ab87163392" acquired by "delete_volume" :: waited 0.023s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:23:51 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-87a77bdc-84ef-4604-b83e-b042a1154ad2 tempest-ProjectReaderTests-104649156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1e6bda4f-1b4c-4405-93b5-03f8dcfd31f0" returned: 0 in 0.340s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:51 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[4323f89a-8eb0-4397-8c6e-4f0109acadae]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:23:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7c483b6f-fb11-4b0b-8270-598e6d9b19e1 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:51 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-87a77bdc-84ef-4604-b83e-b042a1154ad2 tempest-ProjectReaderTests-104649156 None] Lock "cinder-quobyte-1e6bda4f-1b4c-4405-93b5-03f8dcfd31f0" released by "delete_volume" :: held 0.901s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:51 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-87a77bdc-84ef-4604-b83e-b042a1154ad2 tempest-ProjectReaderTests-104649156 None] Created reservations ['2e78e715-5b83-46fa-9e1e-1f1b1ebc6132', '5a6634fe-7fd1-4458-9f43-c6a70f730ca2', '66510dca-6cc2-44df-9422-6bc0e82e7f94', 'c11a6d2d-1326-4ca3-b7fb-963112aeee9b'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:23:51 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392 Sep 01 08:23:51 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-87a77bdc-84ef-4604-b83e-b042a1154ad2 tempest-ProjectReaderTests-104649156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-87a77bdc-84ef-4604-b83e-b042a1154ad2 tempest-ProjectReaderTests-104649156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:51 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-87a77bdc-84ef-4604-b83e-b042a1154ad2 tempest-ProjectReaderTests-104649156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:51 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-87a77bdc-84ef-4604-b83e-b042a1154ad2 tempest-ProjectReaderTests-104649156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-87a77bdc-84ef-4604-b83e-b042a1154ad2 tempest-ProjectReaderTests-104649156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-87a77bdc-84ef-4604-b83e-b042a1154ad2 tempest-ProjectReaderTests-104649156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:51 devstack sudo[98672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:23:51 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:52 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7c483b6f-fb11-4b0b-8270-598e6d9b19e1 tempest-GroupSnapshotsTest-2124917916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392" returned: 0 in 0.520s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7c483b6f-fb11-4b0b-8270-598e6d9b19e1 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:52 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-87a77bdc-84ef-4604-b83e-b042a1154ad2 tempest-ProjectReaderTests-104649156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.348s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:52 devstack sudo[98679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392 Sep 01 08:23:52 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:52 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-87a77bdc-84ef-4604-b83e-b042a1154ad2 tempest-ProjectReaderTests-104649156 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:23:52 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-87a77bdc-84ef-4604-b83e-b042a1154ad2 tempest-ProjectReaderTests-104649156 None] Deleted volume successfully. Sep 01 08:23:52 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-87a77bdc-84ef-4604-b83e-b042a1154ad2 tempest-ProjectReaderTests-104649156 None] Lock "cinder-1e6bda4f-1b4c-4405-93b5-03f8dcfd31f0-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:52 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7c483b6f-fb11-4b0b-8270-598e6d9b19e1 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c5c4370b-2c83-4691-994f-05ab87163392" returned: 0 in 0.289s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:52 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7c483b6f-fb11-4b0b-8270-598e6d9b19e1 tempest-GroupSnapshotsTest-2124917916 None] Lock "cinder-quobyte-c5c4370b-2c83-4691-994f-05ab87163392" released by "delete_volume" :: held 0.908s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:23:52 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-7c483b6f-fb11-4b0b-8270-598e6d9b19e1 tempest-GroupSnapshotsTest-2124917916 None] Created reservations ['2e978b91-a484-44d7-a405-6be29389ebfd'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:23:52 devstack cinder-volume[86893]: WARNING cinder.quota [None req-7c483b6f-fb11-4b0b-8270-598e6d9b19e1 tempest-GroupSnapshotsTest-2124917916 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-697864892 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-697864892, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:23:52 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-7c483b6f-fb11-4b0b-8270-598e6d9b19e1 tempest-GroupSnapshotsTest-2124917916 None] Created reservations ['6477bad0-fc59-44ee-8213-ffa5fda950b1', 'b52bc32a-3e84-4fd3-a0ed-3892954c8cda', 'a6605456-47aa-440a-ae78-633e411b64ee', 'e88c7967-d4e6-4f41-8f4b-1aee892bb7c3'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:23:52 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-7c483b6f-fb11-4b0b-8270-598e6d9b19e1 tempest-GroupSnapshotsTest-2124917916 None] Created reservations ['a067f8d2-ace7-45ec-bdf7-779e9aeea682', '3099e6fd-fc56-4593-a34d-56344ca1f572', '52fb0603-a664-4b9f-8003-4953563bbbba', '0621257c-a621-4a31-b5e2-742bdda9c4f5'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:23:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7c483b6f-fb11-4b0b-8270-598e6d9b19e1 tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7c483b6f-fb11-4b0b-8270-598e6d9b19e1 tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7c483b6f-fb11-4b0b-8270-598e6d9b19e1 tempest-GroupSnapshotsTest-2124917916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7c483b6f-fb11-4b0b-8270-598e6d9b19e1 tempest-GroupSnapshotsTest-2124917916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7c483b6f-fb11-4b0b-8270-598e6d9b19e1 tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7c483b6f-fb11-4b0b-8270-598e6d9b19e1 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:52 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:23:52 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:53 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7c483b6f-fb11-4b0b-8270-598e6d9b19e1 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.401s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:53 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-7c483b6f-fb11-4b0b-8270-598e6d9b19e1 tempest-GroupSnapshotsTest-2124917916 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:23:53 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-7c483b6f-fb11-4b0b-8270-598e6d9b19e1 tempest-GroupSnapshotsTest-2124917916 None] Delete group completed successfully. Sep 01 08:23:53 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-db8786c5-1272-48ce-97f7-6d8915812ae5 tempest-GroupSnapshotsTest-2124917916 None] Group tempest-GroupSnapshotsTest-Group-337542914: creating Sep 01 08:23:53 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-db8786c5-1272-48ce-97f7-6d8915812ae5 tempest-GroupSnapshotsTest-2124917916 None] Group tempest-GroupSnapshotsTest-Group-337542914: created successfully Sep 01 08:23:53 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-db8786c5-1272-48ce-97f7-6d8915812ae5 tempest-GroupSnapshotsTest-2124917916 None] Create group completed successfully. Sep 01 08:23:55 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:23:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] Flow 'volume_create_manager' (c4d2c5e5-6546-4320-a4d6-e278fb0cf2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:23:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49cbbd13-f136-4132-8c5e-e83b348bc6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49cbbd13-f136-4132-8c5e-e83b348bc6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1163445952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=978196f6-cd0d-4b3e-9ef8-65f1468dc0e4,host='devstack@QuobyteHD#QuobyteHD',id=2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='398f1e5b275b4d57924f6d60ecfb7b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:23:55Z,use_quota=True,user_id='97b2795a14024d93bdd8a1e9312459bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4bcff4-6593-49c4-a79d-eadc78404dd5),volume_type_id=3f4bcff4-6593-49c4-a79d-eadc78404dd5)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d8f696-2ae7-48f4-aab7-2a86088796ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d8f696-2ae7-48f4-aab7-2a86088796ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (195cb6f8-18a3-4332-9239-ffbcc3cc4ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (195cb6f8-18a3-4332-9239-ffbcc3cc4ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519', 'volume_name': 'volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dfa2103-5df5-484a-9623-af7823c7741b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dfa2103-5df5-484a-9623-af7823c7741b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8bce01d-38ff-46c4-b533-76e2251c95e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:55 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] Volume 2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519', 'volume_size': 1} Sep 01 08:23:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:55 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=978196f6-cd0d-4b3e-9ef8-65f1468dc0e4,created_at=2026-09-01T06:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1163445952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=978196f6-cd0d-4b3e-9ef8-65f1468dc0e4,host='devstack@QuobyteHD#QuobyteHD',id=2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='398f1e5b275b4d57924f6d60ecfb7b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:23:55Z,use_quota=True,user_id='97b2795a14024d93bdd8a1e9312459bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4bcff4-6593-49c4-a79d-eadc78404dd5),volume_type_id=3f4bcff4-6593-49c4-a79d-eadc78404dd5)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:23:55 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] Creating volume 2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:23:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:55 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:55 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:55 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:23:55 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:23:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:55 devstack sudo[98687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519 1073741824 Sep 01 08:23:55 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:56 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:23:56 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] Flow 'volume_create_manager' (f79c6690-9961-4446-a5b4-03022fb85ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:23:56 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fbd7c05-d42e-444e-9b2c-698456211940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:56 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fbd7c05-d42e-444e-9b2c-698456211940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2076136428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cb7aa3e-dfcf-4141-8243-b69928f50f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='461dcacf8f3348008a31131eaba615ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:23:56Z,use_quota=True,user_id='cd1064f842a6480eb8c2ce79b9879eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:56 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6898bd10-c04f-4c8f-aaf9-82032dd8ed85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:56 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6898bd10-c04f-4c8f-aaf9-82032dd8ed85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:56 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:56 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecaaab41-c3ca-4870-9ff9-9bbd238b51ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:56 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecaaab41-c3ca-4870-9ff9-9bbd238b51ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cb7aa3e-dfcf-4141-8243-b69928f50f85', 'volume_name': 'volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:56 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (174f26d3-2c07-4ef2-85b7-85b18a642b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:56 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (174f26d3-2c07-4ef2-85b7-85b18a642b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:56 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ecebb68-e727-466a-8a3f-3bbe859b9e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:56 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] Volume 4cb7aa3e-dfcf-4141-8243-b69928f50f85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85', 'volume_size': 1} Sep 01 08:23:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519 1073741824" returned: 0 in 0.596s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:56 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519 Sep 01 08:23:56 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:56 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519" returned: 0 in 0.251s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:56 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:23:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.288s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:56 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2076136428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cb7aa3e-dfcf-4141-8243-b69928f50f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='461dcacf8f3348008a31131eaba615ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:23:56Z,use_quota=True,user_id='cd1064f842a6480eb8c2ce79b9879eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:23:56 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] Creating volume 4cb7aa3e-dfcf-4141-8243-b69928f50f85 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:23:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:56 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:23:56 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:23:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:56 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:23:56 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:23:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:56 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8bce01d-38ff-46c4-b533-76e2251c95e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:56 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a8e141-ae89-4d4a-91dc-60535fea3e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:56 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85 1073741824 Sep 01 08:23:56 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:56 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] Volume volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519 (2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519): created successfully Sep 01 08:23:56 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a8e141-ae89-4d4a-91dc-60535fea3e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:56 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] Flow 'volume_create_manager' (c4d2c5e5-6546-4320-a4d6-e278fb0cf2aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:23:56 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-f918fe11-bc8e-4013-8850-01b6824a3846 tempest-GroupSnapshotsTest-2124917916 None] Created volume successfully. Sep 01 08:23:57 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-0b87af49-b781-46ed-a106-6d02fcaeafaf tempest-GroupSnapshotsTest-2124917916 None] GroupSnapshot d6406c1d-bc22-40e4-b5b8-a2a2126132bc: creating. Sep 01 08:23:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0b87af49-b781-46ed-a106-6d02fcaeafaf tempest-GroupSnapshotsTest-2124917916 None] Group snapshot d6406c1d-bc22-40e4-b5b8-a2a2126132bc: creating. {{(pid=86893) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 08:23:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0b87af49-b781-46ed-a106-6d02fcaeafaf tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:57 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85 1073741824" returned: 0 in 0.593s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:57 devstack sudo[98702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85 Sep 01 08:23:57 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:57 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85" returned: 0 in 0.250s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:23:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0b87af49-b781-46ed-a106-6d02fcaeafaf tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.330s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ecebb68-e727-466a-8a3f-3bbe859b9e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8201cc6f-3932-4bca-973c-75d56acc43e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:23:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-0b87af49-b781-46ed-a106-6d02fcaeafaf tempest-GroupSnapshotsTest-2124917916 None] Creating offline snapshot 478f5d91-2e20-4541-b300-0c0272a6197c of volume 2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519 {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:23:57 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] Volume volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85 (4cb7aa3e-dfcf-4141-8243-b69928f50f85): created successfully Sep 01 08:23:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8201cc6f-3932-4bca-973c-75d56acc43e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:23:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] Flow 'volume_create_manager' (f79c6690-9961-4446-a5b4-03022fb85ed5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:23:57 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56c5d94-b1d3-4f20-bb45-30a73b850c49]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:23:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0b87af49-b781-46ed-a106-6d02fcaeafaf tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:57 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-218d5c71-2864-4802-9957-0d025a98b4b4 tempest-SnapshotsActionsTest-562509859 None] Created volume successfully. Sep 01 08:23:57 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519 Sep 01 08:23:57 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:57 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0b87af49-b781-46ed-a106-6d02fcaeafaf tempest-GroupSnapshotsTest-2124917916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519" returned: 0 in 0.371s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0b87af49-b781-46ed-a106-6d02fcaeafaf tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519.478f5d91-2e20-4541-b300-0c0272a6197c 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:57 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519.478f5d91-2e20-4541-b300-0c0272a6197c 1G Sep 01 08:23:57 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:58 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0b87af49-b781-46ed-a106-6d02fcaeafaf tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519.478f5d91-2e20-4541-b300-0c0272a6197c 1G" returned: 0 in 0.417s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0b87af49-b781-46ed-a106-6d02fcaeafaf tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519.478f5d91-2e20-4541-b300-0c0272a6197c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:58 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519.478f5d91-2e20-4541-b300-0c0272a6197c Sep 01 08:23:58 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-988e7ecc-d2a9-4492-a052-341f5a555e50 tempest-SnapshotsActionsTest-562509859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:23:58 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0b87af49-b781-46ed-a106-6d02fcaeafaf tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519.478f5d91-2e20-4541-b300-0c0272a6197c" returned: 0 in 0.287s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:58 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-0b87af49-b781-46ed-a106-6d02fcaeafaf tempest-GroupSnapshotsTest-2124917916 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519.478f5d91-2e20-4541-b300-0c0272a6197c is being set with open permissions: ugo+rw: NotImplementedError Sep 01 08:23:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0b87af49-b781-46ed-a106-6d02fcaeafaf tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519.478f5d91-2e20-4541-b300-0c0272a6197c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:58 devstack sudo[98722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519.478f5d91-2e20-4541-b300-0c0272a6197c Sep 01 08:23:58 devstack sudo[98722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:58 devstack sudo[98722]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0b87af49-b781-46ed-a106-6d02fcaeafaf tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519.478f5d91-2e20-4541-b300-0c0272a6197c" returned: 0 in 0.233s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0b87af49-b781-46ed-a106-6d02fcaeafaf tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:58 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519.info Sep 01 08:23:58 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:59 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0b87af49-b781-46ed-a106-6d02fcaeafaf tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519.info" returned: 0 in 0.244s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:59 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-0b87af49-b781-46ed-a106-6d02fcaeafaf tempest-GroupSnapshotsTest-2124917916 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 08:23:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0b87af49-b781-46ed-a106-6d02fcaeafaf tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:59 devstack sudo[98728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519.info Sep 01 08:23:59 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:59 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0b87af49-b781-46ed-a106-6d02fcaeafaf tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519.info" returned: 0 in 0.238s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0b87af49-b781-46ed-a106-6d02fcaeafaf tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.886s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:23:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-988e7ecc-d2a9-4492-a052-341f5a555e50 tempest-SnapshotsActionsTest-562509859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.922s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:23:59 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-988e7ecc-d2a9-4492-a052-341f5a555e50 tempest-SnapshotsActionsTest-562509859 None] Creating offline snapshot 4c2b3306-0c27-4c93-ac19-ae767522692c of volume 4cb7aa3e-dfcf-4141-8243-b69928f50f85 {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:23:59 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c10aab-f1f2-41c2-8934-b1ade51f9083]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:23:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-988e7ecc-d2a9-4492-a052-341f5a555e50 tempest-SnapshotsActionsTest-562509859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:59 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-0b87af49-b781-46ed-a106-6d02fcaeafaf tempest-GroupSnapshotsTest-2124917916 None] group_snapshot d6406c1d-bc22-40e4-b5b8-a2a2126132bc: created successfully Sep 01 08:23:59 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85 Sep 01 08:23:59 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:23:59 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Sep 01 08:23:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-988e7ecc-d2a9-4492-a052-341f5a555e50 tempest-SnapshotsActionsTest-562509859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85" returned: 0 in 0.358s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:23:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-988e7ecc-d2a9-4492-a052-341f5a555e50 tempest-SnapshotsActionsTest-562509859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:23:59 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c 1G Sep 01 08:23:59 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:00 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-988e7ecc-d2a9-4492-a052-341f5a555e50 tempest-SnapshotsActionsTest-562509859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c 1G" returned: 0 in 0.372s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-988e7ecc-d2a9-4492-a052-341f5a555e50 tempest-SnapshotsActionsTest-562509859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:00 devstack sudo[98741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c Sep 01 08:24:00 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:00 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:00 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-a70fcd42-7c35-41ef-9534-69d863fbd5d4 tempest-GroupSnapshotsTest-2124917916 None] group_snapshot d6406c1d-bc22-40e4-b5b8-a2a2126132bc: deleting Sep 01 08:24:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-988e7ecc-d2a9-4492-a052-341f5a555e50 tempest-SnapshotsActionsTest-562509859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c" returned: 0 in 0.308s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:00 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-988e7ecc-d2a9-4492-a052-341f5a555e50 tempest-SnapshotsActionsTest-562509859 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c is being set with open permissions: ugo+rw Sep 01 08:24:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-988e7ecc-d2a9-4492-a052-341f5a555e50 tempest-SnapshotsActionsTest-562509859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:00 devstack sudo[98746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c Sep 01 08:24:00 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:00 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a70fcd42-7c35-41ef-9534-69d863fbd5d4 tempest-GroupSnapshotsTest-2124917916 None] group_snapshot d6406c1d-bc22-40e4-b5b8-a2a2126132bc: deleting {{(pid=86893) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 08:24:00 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a70fcd42-7c35-41ef-9534-69d863fbd5d4 tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "cinder-quobyte-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:00 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a70fcd42-7c35-41ef-9534-69d863fbd5d4 tempest-GroupSnapshotsTest-2124917916 None] Lock "cinder-quobyte-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:00 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a70fcd42-7c35-41ef-9534-69d863fbd5d4 tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "cinder-quobyte-478f5d91-2e20-4541-b300-0c0272a6197c" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:00 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a70fcd42-7c35-41ef-9534-69d863fbd5d4 tempest-GroupSnapshotsTest-2124917916 None] Lock "cinder-quobyte-478f5d91-2e20-4541-b300-0c0272a6197c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:00 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-a70fcd42-7c35-41ef-9534-69d863fbd5d4 tempest-GroupSnapshotsTest-2124917916 None] Deleting offline snapshot 478f5d91-2e20-4541-b300-0c0272a6197c of volume 2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:24:00 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-a70fcd42-7c35-41ef-9534-69d863fbd5d4 tempest-GroupSnapshotsTest-2124917916 None] snapshot_file for this snap is: volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519.478f5d91-2e20-4541-b300-0c0272a6197c {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:24:00 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4787a32-1523-4a6b-8c27-c5b6b8bb8982]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:24:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a70fcd42-7c35-41ef-9534-69d863fbd5d4 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519.478f5d91-2e20-4541-b300-0c0272a6197c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:00 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-988e7ecc-d2a9-4492-a052-341f5a555e50 tempest-SnapshotsActionsTest-562509859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c" returned: 0 in 0.277s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:00 devstack sudo[98748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519.478f5d91-2e20-4541-b300-0c0272a6197c Sep 01 08:24:00 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-988e7ecc-d2a9-4492-a052-341f5a555e50 tempest-SnapshotsActionsTest-562509859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:00 devstack sudo[98751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.info Sep 01 08:24:00 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:00 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a70fcd42-7c35-41ef-9534-69d863fbd5d4 tempest-GroupSnapshotsTest-2124917916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519.478f5d91-2e20-4541-b300-0c0272a6197c" returned: 0 in 0.370s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:00 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-a70fcd42-7c35-41ef-9534-69d863fbd5d4 tempest-GroupSnapshotsTest-2124917916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:24:00 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-988e7ecc-d2a9-4492-a052-341f5a555e50 tempest-SnapshotsActionsTest-562509859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.info" returned: 0 in 0.246s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:00 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-988e7ecc-d2a9-4492-a052-341f5a555e50 tempest-SnapshotsActionsTest-562509859 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.info is being set with open permissions: ugo+rw Sep 01 08:24:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-988e7ecc-d2a9-4492-a052-341f5a555e50 tempest-SnapshotsActionsTest-562509859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:00 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[e579efa9-2c0b-4db7-b2d3-105632196fea]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:24:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a70fcd42-7c35-41ef-9534-69d863fbd5d4 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:00 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.info Sep 01 08:24:00 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:01 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519 Sep 01 08:24:01 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:01 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-988e7ecc-d2a9-4492-a052-341f5a555e50 tempest-SnapshotsActionsTest-562509859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.info" returned: 0 in 0.247s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-988e7ecc-d2a9-4492-a052-341f5a555e50 tempest-SnapshotsActionsTest-562509859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.890s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:24:01 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-988e7ecc-d2a9-4492-a052-341f5a555e50 tempest-SnapshotsActionsTest-562509859 None] Create snapshot completed successfully Sep 01 08:24:01 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a70fcd42-7c35-41ef-9534-69d863fbd5d4 tempest-GroupSnapshotsTest-2124917916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519" returned: 0 in 0.349s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a70fcd42-7c35-41ef-9534-69d863fbd5d4 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519.478f5d91-2e20-4541-b300-0c0272a6197c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:01 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519.478f5d91-2e20-4541-b300-0c0272a6197c Sep 01 08:24:01 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:01 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a70fcd42-7c35-41ef-9534-69d863fbd5d4 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519.478f5d91-2e20-4541-b300-0c0272a6197c" returned: 0 in 0.362s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a70fcd42-7c35-41ef-9534-69d863fbd5d4 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519.478f5d91-2e20-4541-b300-0c0272a6197c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:01 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519.478f5d91-2e20-4541-b300-0c0272a6197c Sep 01 08:24:01 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:01 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a70fcd42-7c35-41ef-9534-69d863fbd5d4 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519.478f5d91-2e20-4541-b300-0c0272a6197c" returned: 0 in 0.249s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:01 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a70fcd42-7c35-41ef-9534-69d863fbd5d4 tempest-GroupSnapshotsTest-2124917916 None] Lock "cinder-quobyte-478f5d91-2e20-4541-b300-0c0272a6197c" released by "_delete_snapshot" :: held 1.460s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:01 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a70fcd42-7c35-41ef-9534-69d863fbd5d4 tempest-GroupSnapshotsTest-2124917916 None] Lock "cinder-quobyte-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519" released by "delete_snapshot" :: held 1.487s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:02 devstack cinder-volume[86893]: WARNING cinder.quota [None req-a70fcd42-7c35-41ef-9534-69d863fbd5d4 tempest-GroupSnapshotsTest-2124917916 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-35620991 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-35620991, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:24:02 devstack cinder-volume[86893]: WARNING cinder.quota [None req-a70fcd42-7c35-41ef-9534-69d863fbd5d4 tempest-GroupSnapshotsTest-2124917916 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-35620991 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-35620991, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:24:02 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-a70fcd42-7c35-41ef-9534-69d863fbd5d4 tempest-GroupSnapshotsTest-2124917916 None] Created reservations ['e7aaafe8-a17e-426c-8dec-2de7052e7cb8', '74c17675-4a42-4571-87de-f4306dae3846', '454230e7-d55f-40c1-9e6b-b2231d0acd88', 'ff3ff6ae-75f9-405e-80b8-4376e8f569a4'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:24:02 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-a70fcd42-7c35-41ef-9534-69d863fbd5d4 tempest-GroupSnapshotsTest-2124917916 None] group_snapshot d6406c1d-bc22-40e4-b5b8-a2a2126132bc: deleted successfully Sep 01 08:24:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-684b52e6-a57c-430f-a045-b09fb5b6fc9a tempest-SnapshotsActionsTest-562509859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:24:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-684b52e6-a57c-430f-a045-b09fb5b6fc9a tempest-SnapshotsActionsTest-562509859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:24:02 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-684b52e6-a57c-430f-a045-b09fb5b6fc9a tempest-SnapshotsActionsTest-562509859 None] Creating offline snapshot a7d0a74c-f6bd-457c-8370-988a951ae14e of volume 4cb7aa3e-dfcf-4141-8243-b69928f50f85 {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:24:02 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdee36f-418f-4d2a-91f9-5b152a452d38]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:24:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-684b52e6-a57c-430f-a045-b09fb5b6fc9a tempest-SnapshotsActionsTest-562509859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:02 devstack sudo[98773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c Sep 01 08:24:02 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:02 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-684b52e6-a57c-430f-a045-b09fb5b6fc9a tempest-SnapshotsActionsTest-562509859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c" returned: 0 in 0.357s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:02 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-684b52e6-a57c-430f-a045-b09fb5b6fc9a tempest-SnapshotsActionsTest-562509859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:24:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-684b52e6-a57c-430f-a045-b09fb5b6fc9a tempest-SnapshotsActionsTest-562509859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.a7d0a74c-f6bd-457c-8370-988a951ae14e 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:02 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.a7d0a74c-f6bd-457c-8370-988a951ae14e 1G Sep 01 08:24:02 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:02 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=211,cinder:UPDATE=230,cinder:INSERT=57,cinder:DELETE=11 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:24:02 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=200,cinder:INSERT=45,cinder:UPDATE=216,cinder:DELETE=11 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:24:02 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9a849370-4cc2-44dd-b62f-888feaced410 tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "cinder-quobyte-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:02 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9a849370-4cc2-44dd-b62f-888feaced410 tempest-GroupSnapshotsTest-2124917916 None] Lock "cinder-quobyte-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519" acquired by "delete_volume" :: waited 0.029s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:03 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[5003e51f-eab6-4d8c-9ac9-063d5ea1798f]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:24:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9a849370-4cc2-44dd-b62f-888feaced410 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:03 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-684b52e6-a57c-430f-a045-b09fb5b6fc9a tempest-SnapshotsActionsTest-562509859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.a7d0a74c-f6bd-457c-8370-988a951ae14e 1G" returned: 0 in 0.461s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-684b52e6-a57c-430f-a045-b09fb5b6fc9a tempest-SnapshotsActionsTest-562509859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.a7d0a74c-f6bd-457c-8370-988a951ae14e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:03 devstack sudo[98786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519 Sep 01 08:24:03 devstack sudo[98786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:03 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.a7d0a74c-f6bd-457c-8370-988a951ae14e Sep 01 08:24:03 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:03 devstack sudo[98786]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9a849370-4cc2-44dd-b62f-888feaced410 tempest-GroupSnapshotsTest-2124917916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519" returned: 0 in 0.364s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9a849370-4cc2-44dd-b62f-888feaced410 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:03 devstack sudo[98796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519 Sep 01 08:24:03 devstack sudo[98796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:03 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-684b52e6-a57c-430f-a045-b09fb5b6fc9a tempest-SnapshotsActionsTest-562509859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.a7d0a74c-f6bd-457c-8370-988a951ae14e" returned: 0 in 0.297s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:03 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-684b52e6-a57c-430f-a045-b09fb5b6fc9a tempest-SnapshotsActionsTest-562509859 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.a7d0a74c-f6bd-457c-8370-988a951ae14e is being set with open permissions: ugo+rw Sep 01 08:24:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-684b52e6-a57c-430f-a045-b09fb5b6fc9a tempest-SnapshotsActionsTest-562509859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.a7d0a74c-f6bd-457c-8370-988a951ae14e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:03 devstack sudo[98798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.a7d0a74c-f6bd-457c-8370-988a951ae14e Sep 01 08:24:03 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:03 devstack sudo[98796]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9a849370-4cc2-44dd-b62f-888feaced410 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519" returned: 0 in 0.248s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:03 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9a849370-4cc2-44dd-b62f-888feaced410 tempest-GroupSnapshotsTest-2124917916 None] Lock "cinder-quobyte-2cd5e72e-b5ea-4df3-92b3-eaab8dcaa519" released by "delete_volume" :: held 0.670s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:03 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-684b52e6-a57c-430f-a045-b09fb5b6fc9a tempest-SnapshotsActionsTest-562509859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.a7d0a74c-f6bd-457c-8370-988a951ae14e" returned: 0 in 0.250s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-684b52e6-a57c-430f-a045-b09fb5b6fc9a tempest-SnapshotsActionsTest-562509859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.482s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:24:03 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-684b52e6-a57c-430f-a045-b09fb5b6fc9a tempest-SnapshotsActionsTest-562509859 None] Create snapshot completed successfully Sep 01 08:24:03 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-9a849370-4cc2-44dd-b62f-888feaced410 tempest-GroupSnapshotsTest-2124917916 None] Created reservations ['a7752b45-6132-4e8c-8ee7-1b8e1cb403cf'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:24:03 devstack cinder-volume[86893]: WARNING cinder.quota [None req-9a849370-4cc2-44dd-b62f-888feaced410 tempest-GroupSnapshotsTest-2124917916 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-35620991 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-35620991, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:24:03 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-9a849370-4cc2-44dd-b62f-888feaced410 tempest-GroupSnapshotsTest-2124917916 None] Created reservations ['2e89ef50-a192-4254-98c2-7b5c956542c4', '8b4f8c8c-4647-46e1-9df7-c837331d86f2', '1b0c2e3e-3cbd-4ac3-a9bd-02146d8bdb9d', '5d16ee0d-f9e8-423b-8762-8d42679742b4'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:24:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9a849370-4cc2-44dd-b62f-888feaced410 tempest-GroupSnapshotsTest-2124917916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:24:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9a849370-4cc2-44dd-b62f-888feaced410 tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:24:03 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-9a849370-4cc2-44dd-b62f-888feaced410 tempest-GroupSnapshotsTest-2124917916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:24:03 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-9a849370-4cc2-44dd-b62f-888feaced410 tempest-GroupSnapshotsTest-2124917916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:24:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9a849370-4cc2-44dd-b62f-888feaced410 tempest-GroupSnapshotsTest-2124917916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:24:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9a849370-4cc2-44dd-b62f-888feaced410 tempest-GroupSnapshotsTest-2124917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:03 devstack sudo[98802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:24:03 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:04 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9a849370-4cc2-44dd-b62f-888feaced410 tempest-GroupSnapshotsTest-2124917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.247s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:04 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-9a849370-4cc2-44dd-b62f-888feaced410 tempest-GroupSnapshotsTest-2124917916 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:24:04 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-9a849370-4cc2-44dd-b62f-888feaced410 tempest-GroupSnapshotsTest-2124917916 None] Delete group completed successfully. Sep 01 08:24:04 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9a5f663f-b009-42e3-b6cb-a46c3d42745f tempest-SnapshotsActionsTest-139994947 None] Acquiring lock "cinder-a7d0a74c-f6bd-457c-8370-988a951ae14e-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:04 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9a5f663f-b009-42e3-b6cb-a46c3d42745f tempest-SnapshotsActionsTest-139994947 None] Lock "cinder-a7d0a74c-f6bd-457c-8370-988a951ae14e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:04 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9a5f663f-b009-42e3-b6cb-a46c3d42745f tempest-SnapshotsActionsTest-139994947 None] Acquiring lock "cinder-quobyte-4cb7aa3e-dfcf-4141-8243-b69928f50f85" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:04 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9a5f663f-b009-42e3-b6cb-a46c3d42745f tempest-SnapshotsActionsTest-139994947 None] Lock "cinder-quobyte-4cb7aa3e-dfcf-4141-8243-b69928f50f85" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:04 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9a5f663f-b009-42e3-b6cb-a46c3d42745f tempest-SnapshotsActionsTest-139994947 None] Acquiring lock "cinder-quobyte-a7d0a74c-f6bd-457c-8370-988a951ae14e" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:04 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9a5f663f-b009-42e3-b6cb-a46c3d42745f tempest-SnapshotsActionsTest-139994947 None] Lock "cinder-quobyte-a7d0a74c-f6bd-457c-8370-988a951ae14e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:04 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-9a5f663f-b009-42e3-b6cb-a46c3d42745f tempest-SnapshotsActionsTest-139994947 None] Deleting offline snapshot a7d0a74c-f6bd-457c-8370-988a951ae14e of volume 4cb7aa3e-dfcf-4141-8243-b69928f50f85 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:24:04 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-9a5f663f-b009-42e3-b6cb-a46c3d42745f tempest-SnapshotsActionsTest-139994947 None] snapshot_file for this snap is: volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.a7d0a74c-f6bd-457c-8370-988a951ae14e {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:24:04 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a61177-b88c-4128-ba3c-755f73132baa]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:24:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9a5f663f-b009-42e3-b6cb-a46c3d42745f tempest-SnapshotsActionsTest-139994947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.a7d0a74c-f6bd-457c-8370-988a951ae14e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:04 devstack sudo[98805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.a7d0a74c-f6bd-457c-8370-988a951ae14e Sep 01 08:24:04 devstack sudo[98805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:04 devstack sudo[98805]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9a5f663f-b009-42e3-b6cb-a46c3d42745f tempest-SnapshotsActionsTest-139994947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.a7d0a74c-f6bd-457c-8370-988a951ae14e" returned: 0 in 0.397s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:04 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-9a5f663f-b009-42e3-b6cb-a46c3d42745f tempest-SnapshotsActionsTest-139994947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:24:04 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[f108cbe4-c336-44d4-9cda-1da2e1006ea2]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:24:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9a5f663f-b009-42e3-b6cb-a46c3d42745f tempest-SnapshotsActionsTest-139994947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:05 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c Sep 01 08:24:05 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:05 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9a5f663f-b009-42e3-b6cb-a46c3d42745f tempest-SnapshotsActionsTest-139994947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c" returned: 0 in 0.378s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:05 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-9a5f663f-b009-42e3-b6cb-a46c3d42745f tempest-SnapshotsActionsTest-139994947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:24:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9a5f663f-b009-42e3-b6cb-a46c3d42745f tempest-SnapshotsActionsTest-139994947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.a7d0a74c-f6bd-457c-8370-988a951ae14e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:05 devstack sudo[98815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.a7d0a74c-f6bd-457c-8370-988a951ae14e Sep 01 08:24:05 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:05 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9a5f663f-b009-42e3-b6cb-a46c3d42745f tempest-SnapshotsActionsTest-139994947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.a7d0a74c-f6bd-457c-8370-988a951ae14e" returned: 0 in 0.382s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9a5f663f-b009-42e3-b6cb-a46c3d42745f tempest-SnapshotsActionsTest-139994947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.a7d0a74c-f6bd-457c-8370-988a951ae14e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:05 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.a7d0a74c-f6bd-457c-8370-988a951ae14e Sep 01 08:24:05 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:05 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9a5f663f-b009-42e3-b6cb-a46c3d42745f tempest-SnapshotsActionsTest-139994947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.a7d0a74c-f6bd-457c-8370-988a951ae14e" returned: 0 in 0.257s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:06 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9a5f663f-b009-42e3-b6cb-a46c3d42745f tempest-SnapshotsActionsTest-139994947 None] Lock "cinder-quobyte-a7d0a74c-f6bd-457c-8370-988a951ae14e" released by "_delete_snapshot" :: held 1.531s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:06 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9a5f663f-b009-42e3-b6cb-a46c3d42745f tempest-SnapshotsActionsTest-139994947 None] Lock "cinder-quobyte-4cb7aa3e-dfcf-4141-8243-b69928f50f85" released by "delete_snapshot" :: held 1.552s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:06 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-9a5f663f-b009-42e3-b6cb-a46c3d42745f tempest-SnapshotsActionsTest-139994947 None] Created reservations ['4d41b566-50eb-4dd4-924a-9433badf09f5', 'c4a96459-7d5d-4cb5-b891-ca0e181c9559', '21cde498-4356-4cd4-82ea-ac91887d9c5f', '027bf5be-0211-45ee-b87f-68dfaa2f02d4'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:24:06 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-9a5f663f-b009-42e3-b6cb-a46c3d42745f tempest-SnapshotsActionsTest-139994947 None] Delete snapshot completed successfully. Sep 01 08:24:06 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9a5f663f-b009-42e3-b6cb-a46c3d42745f tempest-SnapshotsActionsTest-139994947 None] Lock "cinder-a7d0a74c-f6bd-457c-8370-988a951ae14e-delete_snapshot" released by "delete_snapshot" :: held 1.718s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:06 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-27627d04-3c01-4911-8e62-d1673220bc35 tempest-SnapshotsActionsTest-562509859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:24:06 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-27627d04-3c01-4911-8e62-d1673220bc35 tempest-SnapshotsActionsTest-562509859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:24:06 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-27627d04-3c01-4911-8e62-d1673220bc35 tempest-SnapshotsActionsTest-562509859 None] Creating offline snapshot 3c893f15-825b-4f85-81cc-31aad309a9d6 of volume 4cb7aa3e-dfcf-4141-8243-b69928f50f85 {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:24:06 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[0506d5a8-2a84-43c4-a0f7-b7920bb18506]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:24:06 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27627d04-3c01-4911-8e62-d1673220bc35 tempest-SnapshotsActionsTest-562509859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:07 devstack sudo[98824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c Sep 01 08:24:07 devstack sudo[98824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:07 devstack sudo[98824]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27627d04-3c01-4911-8e62-d1673220bc35 tempest-SnapshotsActionsTest-562509859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c" returned: 0 in 0.370s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:07 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-27627d04-3c01-4911-8e62-d1673220bc35 tempest-SnapshotsActionsTest-562509859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:24:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27627d04-3c01-4911-8e62-d1673220bc35 tempest-SnapshotsActionsTest-562509859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.3c893f15-825b-4f85-81cc-31aad309a9d6 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:07 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.3c893f15-825b-4f85-81cc-31aad309a9d6 1G Sep 01 08:24:07 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:07 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27627d04-3c01-4911-8e62-d1673220bc35 tempest-SnapshotsActionsTest-562509859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.3c893f15-825b-4f85-81cc-31aad309a9d6 1G" returned: 0 in 0.417s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27627d04-3c01-4911-8e62-d1673220bc35 tempest-SnapshotsActionsTest-562509859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.3c893f15-825b-4f85-81cc-31aad309a9d6 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:07 devstack sudo[98836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.3c893f15-825b-4f85-81cc-31aad309a9d6 Sep 01 08:24:07 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:08 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27627d04-3c01-4911-8e62-d1673220bc35 tempest-SnapshotsActionsTest-562509859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.3c893f15-825b-4f85-81cc-31aad309a9d6" returned: 0 in 0.312s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:08 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-27627d04-3c01-4911-8e62-d1673220bc35 tempest-SnapshotsActionsTest-562509859 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.3c893f15-825b-4f85-81cc-31aad309a9d6 is being set with open permissions: ugo+rw Sep 01 08:24:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27627d04-3c01-4911-8e62-d1673220bc35 tempest-SnapshotsActionsTest-562509859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.3c893f15-825b-4f85-81cc-31aad309a9d6 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:08 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.3c893f15-825b-4f85-81cc-31aad309a9d6 Sep 01 08:24:08 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:08 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27627d04-3c01-4911-8e62-d1673220bc35 tempest-SnapshotsActionsTest-562509859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.3c893f15-825b-4f85-81cc-31aad309a9d6" returned: 0 in 0.251s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-27627d04-3c01-4911-8e62-d1673220bc35 tempest-SnapshotsActionsTest-562509859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.454s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:24:08 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-27627d04-3c01-4911-8e62-d1673220bc35 tempest-SnapshotsActionsTest-562509859 None] Create snapshot completed successfully Sep 01 08:24:09 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-107ebb19-e561-4da5-87c6-978bd923c1c5 tempest-SnapshotsActionsTest-139994947 None] Acquiring lock "cinder-3c893f15-825b-4f85-81cc-31aad309a9d6-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:09 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-107ebb19-e561-4da5-87c6-978bd923c1c5 tempest-SnapshotsActionsTest-139994947 None] Lock "cinder-3c893f15-825b-4f85-81cc-31aad309a9d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:09 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-107ebb19-e561-4da5-87c6-978bd923c1c5 tempest-SnapshotsActionsTest-139994947 None] Acquiring lock "cinder-quobyte-4cb7aa3e-dfcf-4141-8243-b69928f50f85" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:09 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-107ebb19-e561-4da5-87c6-978bd923c1c5 tempest-SnapshotsActionsTest-139994947 None] Lock "cinder-quobyte-4cb7aa3e-dfcf-4141-8243-b69928f50f85" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:09 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-107ebb19-e561-4da5-87c6-978bd923c1c5 tempest-SnapshotsActionsTest-139994947 None] Acquiring lock "cinder-quobyte-3c893f15-825b-4f85-81cc-31aad309a9d6" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:09 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-107ebb19-e561-4da5-87c6-978bd923c1c5 tempest-SnapshotsActionsTest-139994947 None] Lock "cinder-quobyte-3c893f15-825b-4f85-81cc-31aad309a9d6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:09 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-107ebb19-e561-4da5-87c6-978bd923c1c5 tempest-SnapshotsActionsTest-139994947 None] Deleting offline snapshot 3c893f15-825b-4f85-81cc-31aad309a9d6 of volume 4cb7aa3e-dfcf-4141-8243-b69928f50f85 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:24:09 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-107ebb19-e561-4da5-87c6-978bd923c1c5 tempest-SnapshotsActionsTest-139994947 None] snapshot_file for this snap is: volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.3c893f15-825b-4f85-81cc-31aad309a9d6 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:24:09 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[88777cdd-f94d-407e-9df8-75ce82f114a1]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:24:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-107ebb19-e561-4da5-87c6-978bd923c1c5 tempest-SnapshotsActionsTest-139994947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.3c893f15-825b-4f85-81cc-31aad309a9d6 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:09 devstack sudo[98886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.3c893f15-825b-4f85-81cc-31aad309a9d6 Sep 01 08:24:09 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:09 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-107ebb19-e561-4da5-87c6-978bd923c1c5 tempest-SnapshotsActionsTest-139994947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.3c893f15-825b-4f85-81cc-31aad309a9d6" returned: 0 in 0.368s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:09 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-107ebb19-e561-4da5-87c6-978bd923c1c5 tempest-SnapshotsActionsTest-139994947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:24:09 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[beab02c3-ac9d-4fc7-a34c-0dcb8bed5575]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:24:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-107ebb19-e561-4da5-87c6-978bd923c1c5 tempest-SnapshotsActionsTest-139994947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:09 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c Sep 01 08:24:09 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:09 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-107ebb19-e561-4da5-87c6-978bd923c1c5 tempest-SnapshotsActionsTest-139994947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c" returned: 0 in 0.357s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:09 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-107ebb19-e561-4da5-87c6-978bd923c1c5 tempest-SnapshotsActionsTest-139994947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:24:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-107ebb19-e561-4da5-87c6-978bd923c1c5 tempest-SnapshotsActionsTest-139994947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.3c893f15-825b-4f85-81cc-31aad309a9d6 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:09 devstack sudo[98896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.3c893f15-825b-4f85-81cc-31aad309a9d6 Sep 01 08:24:09 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:10 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-107ebb19-e561-4da5-87c6-978bd923c1c5 tempest-SnapshotsActionsTest-139994947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.3c893f15-825b-4f85-81cc-31aad309a9d6" returned: 0 in 0.379s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-107ebb19-e561-4da5-87c6-978bd923c1c5 tempest-SnapshotsActionsTest-139994947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.3c893f15-825b-4f85-81cc-31aad309a9d6 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:10 devstack sudo[98902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.3c893f15-825b-4f85-81cc-31aad309a9d6 Sep 01 08:24:10 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:10 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-107ebb19-e561-4da5-87c6-978bd923c1c5 tempest-SnapshotsActionsTest-139994947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.3c893f15-825b-4f85-81cc-31aad309a9d6" returned: 0 in 0.291s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:10 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-107ebb19-e561-4da5-87c6-978bd923c1c5 tempest-SnapshotsActionsTest-139994947 None] Lock "cinder-quobyte-3c893f15-825b-4f85-81cc-31aad309a9d6" released by "_delete_snapshot" :: held 1.498s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:10 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-107ebb19-e561-4da5-87c6-978bd923c1c5 tempest-SnapshotsActionsTest-139994947 None] Lock "cinder-quobyte-4cb7aa3e-dfcf-4141-8243-b69928f50f85" released by "delete_snapshot" :: held 1.521s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:10 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-107ebb19-e561-4da5-87c6-978bd923c1c5 tempest-SnapshotsActionsTest-139994947 None] Created reservations ['8cea9259-6f94-4748-8bf4-6f3f376cfbef', '65429605-e05d-44e7-99c7-0aa8d601a5cf', '60cfb6de-2106-4054-ac19-945120f720e6', 'c59cbb31-5394-44fb-ab0c-18df39e606af'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:24:10 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-107ebb19-e561-4da5-87c6-978bd923c1c5 tempest-SnapshotsActionsTest-139994947 None] Delete snapshot completed successfully. Sep 01 08:24:10 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-107ebb19-e561-4da5-87c6-978bd923c1c5 tempest-SnapshotsActionsTest-139994947 None] Lock "cinder-3c893f15-825b-4f85-81cc-31aad309a9d6-delete_snapshot" released by "delete_snapshot" :: held 1.664s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d63c0f1a-ebb3-4131-b984-fe75a3f51225 tempest-SnapshotsActionsTest-562509859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:24:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d63c0f1a-ebb3-4131-b984-fe75a3f51225 tempest-SnapshotsActionsTest-562509859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:24:11 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-d63c0f1a-ebb3-4131-b984-fe75a3f51225 tempest-SnapshotsActionsTest-562509859 None] Creating offline snapshot 800990a0-b14e-4a59-919b-7d5ca877db8a of volume 4cb7aa3e-dfcf-4141-8243-b69928f50f85 {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:24:11 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf24e3cc-e29b-4f53-adbd-f4eb00a692c0]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:24:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d63c0f1a-ebb3-4131-b984-fe75a3f51225 tempest-SnapshotsActionsTest-562509859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:11 devstack sudo[98905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c Sep 01 08:24:11 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:11 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d63c0f1a-ebb3-4131-b984-fe75a3f51225 tempest-SnapshotsActionsTest-562509859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c" returned: 0 in 0.359s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:11 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-d63c0f1a-ebb3-4131-b984-fe75a3f51225 tempest-SnapshotsActionsTest-562509859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:24:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d63c0f1a-ebb3-4131-b984-fe75a3f51225 tempest-SnapshotsActionsTest-562509859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.800990a0-b14e-4a59-919b-7d5ca877db8a 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:12 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.800990a0-b14e-4a59-919b-7d5ca877db8a 1G Sep 01 08:24:12 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:12 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d63c0f1a-ebb3-4131-b984-fe75a3f51225 tempest-SnapshotsActionsTest-562509859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.800990a0-b14e-4a59-919b-7d5ca877db8a 1G" returned: 0 in 0.434s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d63c0f1a-ebb3-4131-b984-fe75a3f51225 tempest-SnapshotsActionsTest-562509859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.800990a0-b14e-4a59-919b-7d5ca877db8a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:12 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.800990a0-b14e-4a59-919b-7d5ca877db8a Sep 01 08:24:12 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:12 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d63c0f1a-ebb3-4131-b984-fe75a3f51225 tempest-SnapshotsActionsTest-562509859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.800990a0-b14e-4a59-919b-7d5ca877db8a" returned: 0 in 0.298s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:12 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-d63c0f1a-ebb3-4131-b984-fe75a3f51225 tempest-SnapshotsActionsTest-562509859 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.800990a0-b14e-4a59-919b-7d5ca877db8a is being set with open permissions: ugo+rw Sep 01 08:24:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d63c0f1a-ebb3-4131-b984-fe75a3f51225 tempest-SnapshotsActionsTest-562509859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.800990a0-b14e-4a59-919b-7d5ca877db8a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:12 devstack sudo[98922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.800990a0-b14e-4a59-919b-7d5ca877db8a Sep 01 08:24:12 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:12 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d63c0f1a-ebb3-4131-b984-fe75a3f51225 tempest-SnapshotsActionsTest-562509859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.800990a0-b14e-4a59-919b-7d5ca877db8a" returned: 0 in 0.257s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d63c0f1a-ebb3-4131-b984-fe75a3f51225 tempest-SnapshotsActionsTest-562509859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.447s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:24:13 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-d63c0f1a-ebb3-4131-b984-fe75a3f51225 tempest-SnapshotsActionsTest-562509859 None] Create snapshot completed successfully Sep 01 08:24:13 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-81fec1d9-e7a4-4627-93e5-081d06188b9b tempest-GroupsV314Test-1527957971 None] Group tempest-GroupsV314Test-Group-725792626: creating Sep 01 08:24:13 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-81fec1d9-e7a4-4627-93e5-081d06188b9b tempest-GroupsV314Test-1527957971 None] Group tempest-GroupsV314Test-Group-725792626: created successfully Sep 01 08:24:13 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-14493704-d0a0-495e-aaa5-0383df27b971 tempest-SnapshotsActionsTest-139994947 None] Acquiring lock "cinder-800990a0-b14e-4a59-919b-7d5ca877db8a-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:13 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-81fec1d9-e7a4-4627-93e5-081d06188b9b tempest-GroupsV314Test-1527957971 None] Create group completed successfully. Sep 01 08:24:13 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-14493704-d0a0-495e-aaa5-0383df27b971 tempest-SnapshotsActionsTest-139994947 None] Lock "cinder-800990a0-b14e-4a59-919b-7d5ca877db8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:13 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-14493704-d0a0-495e-aaa5-0383df27b971 tempest-SnapshotsActionsTest-139994947 None] Acquiring lock "cinder-quobyte-4cb7aa3e-dfcf-4141-8243-b69928f50f85" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:13 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-14493704-d0a0-495e-aaa5-0383df27b971 tempest-SnapshotsActionsTest-139994947 None] Lock "cinder-quobyte-4cb7aa3e-dfcf-4141-8243-b69928f50f85" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:13 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-14493704-d0a0-495e-aaa5-0383df27b971 tempest-SnapshotsActionsTest-139994947 None] Acquiring lock "cinder-quobyte-800990a0-b14e-4a59-919b-7d5ca877db8a" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:13 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-14493704-d0a0-495e-aaa5-0383df27b971 tempest-SnapshotsActionsTest-139994947 None] Lock "cinder-quobyte-800990a0-b14e-4a59-919b-7d5ca877db8a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:13 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-14493704-d0a0-495e-aaa5-0383df27b971 tempest-SnapshotsActionsTest-139994947 None] Deleting offline snapshot 800990a0-b14e-4a59-919b-7d5ca877db8a of volume 4cb7aa3e-dfcf-4141-8243-b69928f50f85 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:24:13 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-14493704-d0a0-495e-aaa5-0383df27b971 tempest-SnapshotsActionsTest-139994947 None] snapshot_file for this snap is: volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.800990a0-b14e-4a59-919b-7d5ca877db8a {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:24:13 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[f433d690-a803-42b4-9a92-43a1eec16528]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:24:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-14493704-d0a0-495e-aaa5-0383df27b971 tempest-SnapshotsActionsTest-139994947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.800990a0-b14e-4a59-919b-7d5ca877db8a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:13 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.800990a0-b14e-4a59-919b-7d5ca877db8a Sep 01 08:24:13 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:14 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-14493704-d0a0-495e-aaa5-0383df27b971 tempest-SnapshotsActionsTest-139994947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.800990a0-b14e-4a59-919b-7d5ca877db8a" returned: 0 in 0.343s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:14 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-14493704-d0a0-495e-aaa5-0383df27b971 tempest-SnapshotsActionsTest-139994947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:24:14 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[e200799e-c984-47ae-b829-de142abece00]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:24:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-14493704-d0a0-495e-aaa5-0383df27b971 tempest-SnapshotsActionsTest-139994947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:14 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c Sep 01 08:24:14 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:14 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-14493704-d0a0-495e-aaa5-0383df27b971 tempest-SnapshotsActionsTest-139994947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c" returned: 0 in 0.343s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:14 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-14493704-d0a0-495e-aaa5-0383df27b971 tempest-SnapshotsActionsTest-139994947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:24:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-14493704-d0a0-495e-aaa5-0383df27b971 tempest-SnapshotsActionsTest-139994947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.800990a0-b14e-4a59-919b-7d5ca877db8a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:14 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.800990a0-b14e-4a59-919b-7d5ca877db8a Sep 01 08:24:14 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:14 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-14493704-d0a0-495e-aaa5-0383df27b971 tempest-SnapshotsActionsTest-139994947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.800990a0-b14e-4a59-919b-7d5ca877db8a" returned: 0 in 0.387s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-14493704-d0a0-495e-aaa5-0383df27b971 tempest-SnapshotsActionsTest-139994947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.800990a0-b14e-4a59-919b-7d5ca877db8a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:14 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.800990a0-b14e-4a59-919b-7d5ca877db8a Sep 01 08:24:14 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:15 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-14493704-d0a0-495e-aaa5-0383df27b971 tempest-SnapshotsActionsTest-139994947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.800990a0-b14e-4a59-919b-7d5ca877db8a" returned: 0 in 0.266s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:15 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-14493704-d0a0-495e-aaa5-0383df27b971 tempest-SnapshotsActionsTest-139994947 None] Lock "cinder-quobyte-800990a0-b14e-4a59-919b-7d5ca877db8a" released by "_delete_snapshot" :: held 1.445s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:15 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-14493704-d0a0-495e-aaa5-0383df27b971 tempest-SnapshotsActionsTest-139994947 None] Lock "cinder-quobyte-4cb7aa3e-dfcf-4141-8243-b69928f50f85" released by "delete_snapshot" :: held 1.468s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:15 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:24:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] Flow 'volume_create_manager' (af063df7-ec66-4a48-9bf1-e1708dc52e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:24:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c98fb4f7-ff22-4eed-8561-745fc9152d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:24:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c98fb4f7-ff22-4eed-8561-745fc9152d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-658727623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e59b982-9e58-41a5-b55c-4c8664fefa63,host='devstack@QuobyteHD#QuobyteHD',id=45d756e9-99f3-4a58-9c8c-219ee167de84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccbf6b3ac0054de18f42d24d4c1eee9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:24:15Z,use_quota=True,user_id='875fd9d67ac040b48752a9287cab46fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8165ae32-c151-480f-afdb-ceb76cf0440a),volume_type_id=8165ae32-c151-480f-afdb-ceb76cf0440a)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:24:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c861425b-df28-4005-9dd6-0545dda8d238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:24:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c861425b-df28-4005-9dd6-0545dda8d238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:24:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bef7421-5277-4aab-a4cf-1ca54f1a6d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:24:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bef7421-5277-4aab-a4cf-1ca54f1a6d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45d756e9-99f3-4a58-9c8c-219ee167de84', 'volume_name': 'volume-45d756e9-99f3-4a58-9c8c-219ee167de84', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:24:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b9509b5-7d58-4831-9ffc-0c37e8789253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:24:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b9509b5-7d58-4831-9ffc-0c37e8789253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:24:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ba76b3-b484-4c51-8bd4-696fa290bdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:24:15 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] Volume 45d756e9-99f3-4a58-9c8c-219ee167de84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45d756e9-99f3-4a58-9c8c-219ee167de84', 'volume_size': 1} Sep 01 08:24:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:24:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:24:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7e59b982-9e58-41a5-b55c-4c8664fefa63,created_at=2026-09-01T06:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-658727623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e59b982-9e58-41a5-b55c-4c8664fefa63,host='devstack@QuobyteHD#QuobyteHD',id=45d756e9-99f3-4a58-9c8c-219ee167de84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccbf6b3ac0054de18f42d24d4c1eee9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:24:15Z,use_quota=True,user_id='875fd9d67ac040b48752a9287cab46fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8165ae32-c151-480f-afdb-ceb76cf0440a),volume_type_id=8165ae32-c151-480f-afdb-ceb76cf0440a)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:24:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] Creating volume 45d756e9-99f3-4a58-9c8c-219ee167de84 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:24:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:24:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:24:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:24:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:24:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:24:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:24:15 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:24:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:15 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-14493704-d0a0-495e-aaa5-0383df27b971 tempest-SnapshotsActionsTest-139994947 None] Created reservations ['b64c2de2-550a-4ceb-b529-e2f890d40b4f', '34648901-8f02-4758-b7ac-41695ec32190', '82c3f80c-4749-4ee5-a3ed-ade3bba4b1d6', '8e0279dc-5f81-4a18-b0e7-191ec3a19072'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:24:15 devstack sudo[98943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84 1073741824 Sep 01 08:24:15 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:15 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-14493704-d0a0-495e-aaa5-0383df27b971 tempest-SnapshotsActionsTest-139994947 None] Delete snapshot completed successfully. Sep 01 08:24:15 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-14493704-d0a0-495e-aaa5-0383df27b971 tempest-SnapshotsActionsTest-139994947 None] Lock "cinder-800990a0-b14e-4a59-919b-7d5ca877db8a-delete_snapshot" released by "delete_snapshot" :: held 1.727s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:15 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84 1073741824" returned: 0 in 0.406s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:15 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84 Sep 01 08:24:15 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:16 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84" returned: 0 in 0.249s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:24:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:24:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ba76b3-b484-4c51-8bd4-696fa290bdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45d756e9-99f3-4a58-9c8c-219ee167de84', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:24:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f89dd1f3-6dfe-403b-bf37-e5bf15cacb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:24:16 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] Volume volume-45d756e9-99f3-4a58-9c8c-219ee167de84 (45d756e9-99f3-4a58-9c8c-219ee167de84): created successfully Sep 01 08:24:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f89dd1f3-6dfe-403b-bf37-e5bf15cacb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:24:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] Flow 'volume_create_manager' (af063df7-ec66-4a48-9bf1-e1708dc52e81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:24:16 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-c87b1872-7938-47fe-8627-2469ef523e73 tempest-GroupsV314Test-1527957971 None] Created volume successfully. Sep 01 08:24:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a9d3612c-1c65-4641-82b6-20461b1df8de tempest-SnapshotsActionsTest-562509859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:24:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a9d3612c-1c65-4641-82b6-20461b1df8de tempest-SnapshotsActionsTest-562509859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:24:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-a9d3612c-1c65-4641-82b6-20461b1df8de tempest-SnapshotsActionsTest-562509859 None] Creating offline snapshot 81638fee-1557-4337-91fb-2828a46b8846 of volume 4cb7aa3e-dfcf-4141-8243-b69928f50f85 {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:24:16 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b848e1-6212-47d8-95fb-3bbe41cae03d]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:24:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a9d3612c-1c65-4641-82b6-20461b1df8de tempest-SnapshotsActionsTest-562509859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:16 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c Sep 01 08:24:16 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:16 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a9d3612c-1c65-4641-82b6-20461b1df8de tempest-SnapshotsActionsTest-562509859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c" returned: 0 in 0.367s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-a9d3612c-1c65-4641-82b6-20461b1df8de tempest-SnapshotsActionsTest-562509859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:24:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a9d3612c-1c65-4641-82b6-20461b1df8de tempest-SnapshotsActionsTest-562509859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.81638fee-1557-4337-91fb-2828a46b8846 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:16 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.81638fee-1557-4337-91fb-2828a46b8846 1G Sep 01 08:24:16 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:17 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:24:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a9d3612c-1c65-4641-82b6-20461b1df8de tempest-SnapshotsActionsTest-562509859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.81638fee-1557-4337-91fb-2828a46b8846 1G" returned: 0 in 0.450s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a9d3612c-1c65-4641-82b6-20461b1df8de tempest-SnapshotsActionsTest-562509859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.81638fee-1557-4337-91fb-2828a46b8846 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:17 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.81638fee-1557-4337-91fb-2828a46b8846 Sep 01 08:24:17 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:17 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a9d3612c-1c65-4641-82b6-20461b1df8de tempest-SnapshotsActionsTest-562509859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.81638fee-1557-4337-91fb-2828a46b8846" returned: 0 in 0.294s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:17 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-a9d3612c-1c65-4641-82b6-20461b1df8de tempest-SnapshotsActionsTest-562509859 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.81638fee-1557-4337-91fb-2828a46b8846 is being set with open permissions: ugo+rw Sep 01 08:24:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a9d3612c-1c65-4641-82b6-20461b1df8de tempest-SnapshotsActionsTest-562509859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.81638fee-1557-4337-91fb-2828a46b8846 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:17 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.81638fee-1557-4337-91fb-2828a46b8846 Sep 01 08:24:17 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:17 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a9d3612c-1c65-4641-82b6-20461b1df8de tempest-SnapshotsActionsTest-562509859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.81638fee-1557-4337-91fb-2828a46b8846" returned: 0 in 0.241s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a9d3612c-1c65-4641-82b6-20461b1df8de tempest-SnapshotsActionsTest-562509859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.437s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:24:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.568s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:24:17 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Cloning volume 45d756e9-99f3-4a58-9c8c-219ee167de84 to volume d265aef1-8b6e-4aff-b9b9-b0595d2bbfc7 Sep 01 08:24:17 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-a9d3612c-1c65-4641-82b6-20461b1df8de tempest-SnapshotsActionsTest-562509859 None] Create snapshot completed successfully Sep 01 08:24:17 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Creating offline snapshot 8724f2c0-eff6-4578-bf42-a84cea2220fb of volume 45d756e9-99f3-4a58-9c8c-219ee167de84 {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:24:17 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[e050141b-227c-48d0-9377-36cd01eecdea]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:24:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:17 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84 Sep 01 08:24:17 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:18 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84" returned: 0 in 0.350s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84.8724f2c0-eff6-4578-bf42-a84cea2220fb 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:18 devstack sudo[98977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84.8724f2c0-eff6-4578-bf42-a84cea2220fb 1G Sep 01 08:24:18 devstack sudo[98977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:18 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2feb47f0-6e26-4df4-92ef-c4735951087e tempest-SnapshotsActionsTest-139994947 None] Acquiring lock "cinder-81638fee-1557-4337-91fb-2828a46b8846-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:18 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2feb47f0-6e26-4df4-92ef-c4735951087e tempest-SnapshotsActionsTest-139994947 None] Lock "cinder-81638fee-1557-4337-91fb-2828a46b8846-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:18 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2feb47f0-6e26-4df4-92ef-c4735951087e tempest-SnapshotsActionsTest-139994947 None] Acquiring lock "cinder-quobyte-4cb7aa3e-dfcf-4141-8243-b69928f50f85" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:18 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2feb47f0-6e26-4df4-92ef-c4735951087e tempest-SnapshotsActionsTest-139994947 None] Lock "cinder-quobyte-4cb7aa3e-dfcf-4141-8243-b69928f50f85" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:18 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2feb47f0-6e26-4df4-92ef-c4735951087e tempest-SnapshotsActionsTest-139994947 None] Acquiring lock "cinder-quobyte-81638fee-1557-4337-91fb-2828a46b8846" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:18 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2feb47f0-6e26-4df4-92ef-c4735951087e tempest-SnapshotsActionsTest-139994947 None] Lock "cinder-quobyte-81638fee-1557-4337-91fb-2828a46b8846" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:18 devstack sudo[98977]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:18 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-2feb47f0-6e26-4df4-92ef-c4735951087e tempest-SnapshotsActionsTest-139994947 None] Deleting offline snapshot 81638fee-1557-4337-91fb-2828a46b8846 of volume 4cb7aa3e-dfcf-4141-8243-b69928f50f85 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:24:18 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-2feb47f0-6e26-4df4-92ef-c4735951087e tempest-SnapshotsActionsTest-139994947 None] snapshot_file for this snap is: volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.81638fee-1557-4337-91fb-2828a46b8846 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:24:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84.8724f2c0-eff6-4578-bf42-a84cea2220fb 1G" returned: 0 in 0.463s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45d756e9-99f3-4a58-9c8c-219ee167de84 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84.8724f2c0-eff6-4578-bf42-a84cea2220fb {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:18 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[f098388f-9b59-41ed-8604-40aadbd51b07]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:24:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2feb47f0-6e26-4df4-92ef-c4735951087e tempest-SnapshotsActionsTest-139994947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.81638fee-1557-4337-91fb-2828a46b8846 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:18 devstack sudo[98983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45d756e9-99f3-4a58-9c8c-219ee167de84 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84.8724f2c0-eff6-4578-bf42-a84cea2220fb Sep 01 08:24:18 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:18 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.81638fee-1557-4337-91fb-2828a46b8846 Sep 01 08:24:18 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:18 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45d756e9-99f3-4a58-9c8c-219ee167de84 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84.8724f2c0-eff6-4578-bf42-a84cea2220fb" returned: 0 in 0.291s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:18 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84.8724f2c0-eff6-4578-bf42-a84cea2220fb is being set with open permissions: ugo+rw: NotImplementedError Sep 01 08:24:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84.8724f2c0-eff6-4578-bf42-a84cea2220fb {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:18 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84.8724f2c0-eff6-4578-bf42-a84cea2220fb Sep 01 08:24:18 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:18 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2feb47f0-6e26-4df4-92ef-c4735951087e tempest-SnapshotsActionsTest-139994947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.81638fee-1557-4337-91fb-2828a46b8846" returned: 0 in 0.390s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:18 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-2feb47f0-6e26-4df4-92ef-c4735951087e tempest-SnapshotsActionsTest-139994947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:24:18 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22520d9-7e0e-4df7-af6b-b98d93174f85]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:24:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2feb47f0-6e26-4df4-92ef-c4735951087e tempest-SnapshotsActionsTest-139994947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:19 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84.8724f2c0-eff6-4578-bf42-a84cea2220fb" returned: 0 in 0.261s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:19 devstack sudo[98995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c Sep 01 08:24:19 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:19 devstack sudo[98999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84.info Sep 01 08:24:19 devstack sudo[98999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:19 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2feb47f0-6e26-4df4-92ef-c4735951087e tempest-SnapshotsActionsTest-139994947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c" returned: 0 in 0.363s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:19 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-2feb47f0-6e26-4df4-92ef-c4735951087e tempest-SnapshotsActionsTest-139994947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:24:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2feb47f0-6e26-4df4-92ef-c4735951087e tempest-SnapshotsActionsTest-139994947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.81638fee-1557-4337-91fb-2828a46b8846 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:19 devstack sudo[99004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.81638fee-1557-4337-91fb-2828a46b8846 Sep 01 08:24:19 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:19 devstack sudo[98999]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84.info" returned: 0 in 0.257s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:19 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 08:24:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:19 devstack sudo[99007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84.info Sep 01 08:24:19 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:19 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84.info" returned: 0 in 0.248s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:19 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Acquiring lock "cinder-quobyte-d265aef1-8b6e-4aff-b9b9-b0595d2bbfc7" by "_copy_volume_from_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:19 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Lock "cinder-quobyte-d265aef1-8b6e-4aff-b9b9-b0595d2bbfc7" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:19 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] snapshot: 8724f2c0-eff6-4578-bf42-a84cea2220fb, volume: d265aef1-8b6e-4aff-b9b9-b0595d2bbfc7, {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 08:24:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:24:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:24:19 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:24:19 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:24:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:24:19 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5e159e-96d4-4d82-aeee-e439e7e8e95f]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:24:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84.8724f2c0-eff6-4578-bf42-a84cea2220fb {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:19 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2feb47f0-6e26-4df4-92ef-c4735951087e tempest-SnapshotsActionsTest-139994947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.81638fee-1557-4337-91fb-2828a46b8846" returned: 0 in 0.391s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2feb47f0-6e26-4df4-92ef-c4735951087e tempest-SnapshotsActionsTest-139994947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.81638fee-1557-4337-91fb-2828a46b8846 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:19 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.81638fee-1557-4337-91fb-2828a46b8846 Sep 01 08:24:19 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:19 devstack sudo[99013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84.8724f2c0-eff6-4578-bf42-a84cea2220fb Sep 01 08:24:19 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:19 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2feb47f0-6e26-4df4-92ef-c4735951087e tempest-SnapshotsActionsTest-139994947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.81638fee-1557-4337-91fb-2828a46b8846" returned: 0 in 0.245s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:19 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2feb47f0-6e26-4df4-92ef-c4735951087e tempest-SnapshotsActionsTest-139994947 None] Lock "cinder-quobyte-81638fee-1557-4337-91fb-2828a46b8846" released by "_delete_snapshot" :: held 1.501s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:19 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2feb47f0-6e26-4df4-92ef-c4735951087e tempest-SnapshotsActionsTest-139994947 None] Lock "cinder-quobyte-4cb7aa3e-dfcf-4141-8243-b69928f50f85" released by "delete_snapshot" :: held 1.531s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:20 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-2feb47f0-6e26-4df4-92ef-c4735951087e tempest-SnapshotsActionsTest-139994947 None] Created reservations ['9edeb593-7b88-4eb6-bdf2-1b2123d05362', '473440c5-1da6-4bf2-9987-1419b5d4700d', '89f172c5-ce90-4092-bee4-85681b7899af', 'a77869b4-fd67-44bf-848c-d0b6f7fdcb90'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:24:20 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84.8724f2c0-eff6-4578-bf42-a84cea2220fb" returned: 0 in 0.382s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45d756e9-99f3-4a58-9c8c-219ee167de84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:24:20 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddad68d-dfdd-4f3c-8f29-73d4526eb370]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:24:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:20 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-2feb47f0-6e26-4df4-92ef-c4735951087e tempest-SnapshotsActionsTest-139994947 None] Delete snapshot completed successfully. Sep 01 08:24:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2feb47f0-6e26-4df4-92ef-c4735951087e tempest-SnapshotsActionsTest-139994947 None] Lock "cinder-81638fee-1557-4337-91fb-2828a46b8846-delete_snapshot" released by "delete_snapshot" :: held 1.692s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:20 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84 Sep 01 08:24:20 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:20 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84" returned: 0 in 0.361s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84 {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 08:24:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Creating direct copy from snapshot {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 08:24:20 devstack cinder-volume[86893]: DEBUG cinder.utils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Path /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d265aef1-8b6e-4aff-b9b9-b0595d2bbfc7 not found in is_blk_device check {{(pid=86893) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 08:24:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d265aef1-8b6e-4aff-b9b9-b0595d2bbfc7 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:20 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d265aef1-8b6e-4aff-b9b9-b0595d2bbfc7 Sep 01 08:24:20 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-099b5731-50f7-478d-8efa-aa185882de71 tempest-SnapshotsActionsTest-562509859 None] Acquiring lock "cinder-4c2b3306-0c27-4c93-ac19-ae767522692c-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:21 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-099b5731-50f7-478d-8efa-aa185882de71 tempest-SnapshotsActionsTest-562509859 None] Lock "cinder-4c2b3306-0c27-4c93-ac19-ae767522692c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:21 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-099b5731-50f7-478d-8efa-aa185882de71 tempest-SnapshotsActionsTest-562509859 None] Acquiring lock "cinder-quobyte-4cb7aa3e-dfcf-4141-8243-b69928f50f85" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:21 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-099b5731-50f7-478d-8efa-aa185882de71 tempest-SnapshotsActionsTest-562509859 None] Lock "cinder-quobyte-4cb7aa3e-dfcf-4141-8243-b69928f50f85" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:21 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-099b5731-50f7-478d-8efa-aa185882de71 tempest-SnapshotsActionsTest-562509859 None] Acquiring lock "cinder-quobyte-4c2b3306-0c27-4c93-ac19-ae767522692c" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:21 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-099b5731-50f7-478d-8efa-aa185882de71 tempest-SnapshotsActionsTest-562509859 None] Lock "cinder-quobyte-4c2b3306-0c27-4c93-ac19-ae767522692c" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-099b5731-50f7-478d-8efa-aa185882de71 tempest-SnapshotsActionsTest-562509859 None] Deleting offline snapshot 4c2b3306-0c27-4c93-ac19-ae767522692c of volume 4cb7aa3e-dfcf-4141-8243-b69928f50f85 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:24:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-099b5731-50f7-478d-8efa-aa185882de71 tempest-SnapshotsActionsTest-562509859 None] snapshot_file for this snap is: volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:24:21 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec65d984-547e-4c86-9f58-f5a2a407141a]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:24:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-099b5731-50f7-478d-8efa-aa185882de71 tempest-SnapshotsActionsTest-562509859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:21 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c Sep 01 08:24:21 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:21 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-099b5731-50f7-478d-8efa-aa185882de71 tempest-SnapshotsActionsTest-562509859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c" returned: 0 in 0.724s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-099b5731-50f7-478d-8efa-aa185882de71 tempest-SnapshotsActionsTest-562509859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:24:21 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d099347-dc01-4163-b212-efa8ee960b17]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:24:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-099b5731-50f7-478d-8efa-aa185882de71 tempest-SnapshotsActionsTest-562509859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:22 devstack sudo[99045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85 Sep 01 08:24:22 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:22 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-099b5731-50f7-478d-8efa-aa185882de71 tempest-SnapshotsActionsTest-562509859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85" returned: 0 in 0.746s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-099b5731-50f7-478d-8efa-aa185882de71 tempest-SnapshotsActionsTest-562509859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:22 devstack sudo[99050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c Sep 01 08:24:22 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:23 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-099b5731-50f7-478d-8efa-aa185882de71 tempest-SnapshotsActionsTest-562509859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c" returned: 0 in 0.708s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-099b5731-50f7-478d-8efa-aa185882de71 tempest-SnapshotsActionsTest-562509859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:23 devstack sudo[99056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c Sep 01 08:24:23 devstack sudo[99056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:23 devstack sudo[99056]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-099b5731-50f7-478d-8efa-aa185882de71 tempest-SnapshotsActionsTest-562509859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85.4c2b3306-0c27-4c93-ac19-ae767522692c" returned: 0 in 0.360s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:23 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-099b5731-50f7-478d-8efa-aa185882de71 tempest-SnapshotsActionsTest-562509859 None] Lock "cinder-quobyte-4c2b3306-0c27-4c93-ac19-ae767522692c" released by "_delete_snapshot" :: held 2.813s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:23 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-099b5731-50f7-478d-8efa-aa185882de71 tempest-SnapshotsActionsTest-562509859 None] Lock "cinder-quobyte-4cb7aa3e-dfcf-4141-8243-b69928f50f85" released by "delete_snapshot" :: held 2.867s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:24 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-099b5731-50f7-478d-8efa-aa185882de71 tempest-SnapshotsActionsTest-562509859 None] Created reservations ['2fd0d07f-8f63-4a64-aabe-d092b7f30549', '78d04562-ebb9-4cdf-a782-deaeae8c4ff0', '68d837fb-9a09-4c04-9b91-c85d822139a5', '45e391b7-c20d-4d36-84e2-5f58eed2df53'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:24:24 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-099b5731-50f7-478d-8efa-aa185882de71 tempest-SnapshotsActionsTest-562509859 None] Delete snapshot completed successfully. Sep 01 08:24:24 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-099b5731-50f7-478d-8efa-aa185882de71 tempest-SnapshotsActionsTest-562509859 None] Lock "cinder-4c2b3306-0c27-4c93-ac19-ae767522692c-delete_snapshot" released by "delete_snapshot" :: held 3.159s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:24 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a72aeec4-8cc3-4090-b425-885661ad813d tempest-SnapshotsActionsTest-562509859 None] Acquiring lock "cinder-4cb7aa3e-dfcf-4141-8243-b69928f50f85-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:24 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a72aeec4-8cc3-4090-b425-885661ad813d tempest-SnapshotsActionsTest-562509859 None] Lock "cinder-4cb7aa3e-dfcf-4141-8243-b69928f50f85-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:24 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a72aeec4-8cc3-4090-b425-885661ad813d tempest-SnapshotsActionsTest-562509859 None] Acquiring lock "cinder-quobyte-4cb7aa3e-dfcf-4141-8243-b69928f50f85" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:24 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a72aeec4-8cc3-4090-b425-885661ad813d tempest-SnapshotsActionsTest-562509859 None] Lock "cinder-quobyte-4cb7aa3e-dfcf-4141-8243-b69928f50f85" acquired by "delete_volume" :: waited 0.049s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:24 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb342de7-6b8b-4a42-b7d0-1d2b1827d941]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:24:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a72aeec4-8cc3-4090-b425-885661ad813d tempest-SnapshotsActionsTest-562509859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:24 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85 Sep 01 08:24:24 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:25 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a72aeec4-8cc3-4090-b425-885661ad813d tempest-SnapshotsActionsTest-562509859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85" returned: 0 in 0.647s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a72aeec4-8cc3-4090-b425-885661ad813d tempest-SnapshotsActionsTest-562509859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:25 devstack sudo[99065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85 Sep 01 08:24:25 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:25 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d265aef1-8b6e-4aff-b9b9-b0595d2bbfc7" returned: 0 in 4.998s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:25 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Image conversion details: src /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84, size 1024.00 MB, duration 5.00 sec, destination /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d265aef1-8b6e-4aff-b9b9-b0595d2bbfc7 {{(pid=86893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 08:24:25 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Converted 1024.00 MB image at 204.84 MB/s Sep 01 08:24:25 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d265aef1-8b6e-4aff-b9b9-b0595d2bbfc7 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 08:24:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d265aef1-8b6e-4aff-b9b9-b0595d2bbfc7 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:25 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d265aef1-8b6e-4aff-b9b9-b0595d2bbfc7 Sep 01 08:24:25 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:25 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a72aeec4-8cc3-4090-b425-885661ad813d tempest-SnapshotsActionsTest-562509859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cb7aa3e-dfcf-4141-8243-b69928f50f85" returned: 0 in 0.289s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:25 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a72aeec4-8cc3-4090-b425-885661ad813d tempest-SnapshotsActionsTest-562509859 None] Lock "cinder-quobyte-4cb7aa3e-dfcf-4141-8243-b69928f50f85" released by "delete_volume" :: held 1.059s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:25 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:25 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-a72aeec4-8cc3-4090-b425-885661ad813d tempest-SnapshotsActionsTest-562509859 None] Created reservations ['a386ba7a-3033-42de-ad94-11d784d8830e', '7524be77-e279-4152-b186-66055c8469d2', '4e8214d3-1993-49a5-a660-e6c5e3fcdb20', 'a9055fd5-cf2a-4c57-9934-900ad8fab4ce'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:24:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d265aef1-8b6e-4aff-b9b9-b0595d2bbfc7" returned: 0 in 0.279s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:25 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Lock "cinder-quobyte-d265aef1-8b6e-4aff-b9b9-b0595d2bbfc7" released by "_copy_volume_from_snapshot" :: held 6.098s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:25 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Acquiring lock "cinder-quobyte-8724f2c0-eff6-4578-bf42-a84cea2220fb" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:25 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Lock "cinder-quobyte-8724f2c0-eff6-4578-bf42-a84cea2220fb" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Deleting offline snapshot 8724f2c0-eff6-4578-bf42-a84cea2220fb of volume 45d756e9-99f3-4a58-9c8c-219ee167de84 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:24:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] snapshot_file for this snap is: volume-45d756e9-99f3-4a58-9c8c-219ee167de84.8724f2c0-eff6-4578-bf42-a84cea2220fb {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:24:25 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e7e060-122c-46cf-b70c-c07ca21ad107]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:24:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84.8724f2c0-eff6-4578-bf42-a84cea2220fb {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a72aeec4-8cc3-4090-b425-885661ad813d tempest-SnapshotsActionsTest-562509859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:24:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a72aeec4-8cc3-4090-b425-885661ad813d tempest-SnapshotsActionsTest-562509859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:24:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a72aeec4-8cc3-4090-b425-885661ad813d tempest-SnapshotsActionsTest-562509859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:24:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a72aeec4-8cc3-4090-b425-885661ad813d tempest-SnapshotsActionsTest-562509859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:24:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a72aeec4-8cc3-4090-b425-885661ad813d tempest-SnapshotsActionsTest-562509859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:24:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a72aeec4-8cc3-4090-b425-885661ad813d tempest-SnapshotsActionsTest-562509859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:25 devstack sudo[99072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:24:25 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:25 devstack sudo[99071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84.8724f2c0-eff6-4578-bf42-a84cea2220fb Sep 01 08:24:25 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:26 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a72aeec4-8cc3-4090-b425-885661ad813d tempest-SnapshotsActionsTest-562509859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.253s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:26 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-a72aeec4-8cc3-4090-b425-885661ad813d tempest-SnapshotsActionsTest-562509859 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:24:26 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-a72aeec4-8cc3-4090-b425-885661ad813d tempest-SnapshotsActionsTest-562509859 None] Deleted volume successfully. Sep 01 08:24:26 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a72aeec4-8cc3-4090-b425-885661ad813d tempest-SnapshotsActionsTest-562509859 None] Lock "cinder-4cb7aa3e-dfcf-4141-8243-b69928f50f85-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:26 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84.8724f2c0-eff6-4578-bf42-a84cea2220fb" returned: 0 in 0.361s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:26 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45d756e9-99f3-4a58-9c8c-219ee167de84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:24:26 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8d0f38-ff9f-448c-b55c-efdef9c528cc]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:24:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:26 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84 Sep 01 08:24:26 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:26 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84" returned: 0 in 0.539s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84.8724f2c0-eff6-4578-bf42-a84cea2220fb {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:26 devstack sudo[99085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84.8724f2c0-eff6-4578-bf42-a84cea2220fb Sep 01 08:24:26 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:27 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84.8724f2c0-eff6-4578-bf42-a84cea2220fb" returned: 0 in 0.336s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84.8724f2c0-eff6-4578-bf42-a84cea2220fb {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:27 devstack sudo[99091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84.8724f2c0-eff6-4578-bf42-a84cea2220fb Sep 01 08:24:27 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:27 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84.8724f2c0-eff6-4578-bf42-a84cea2220fb" returned: 0 in 0.246s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:27 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Lock "cinder-quobyte-8724f2c0-eff6-4578-bf42-a84cea2220fb" released by "_delete_snapshot" :: held 1.565s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.734s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:24:27 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-c0771fa1-3e63-4c9c-979a-25aa29e61a3e tempest-GroupsV314Test-1527957971 None] Create group from source-group-7e59b982-9e58-41a5-b55c-4c8664fefa63 completed successfully. Sep 01 08:24:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0c37ab41-3bbe-491c-a534-16e89e567576 tempest-GroupsV314Test-1527957971 None] Acquiring lock "cinder-quobyte-d265aef1-8b6e-4aff-b9b9-b0595d2bbfc7" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0c37ab41-3bbe-491c-a534-16e89e567576 tempest-GroupsV314Test-1527957971 None] Lock "cinder-quobyte-d265aef1-8b6e-4aff-b9b9-b0595d2bbfc7" acquired by "delete_volume" :: waited 0.018s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:28 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3900f9-ed1e-4831-bba2-4f313629d072]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:24:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0c37ab41-3bbe-491c-a534-16e89e567576 tempest-GroupsV314Test-1527957971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d265aef1-8b6e-4aff-b9b9-b0595d2bbfc7 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:28 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d265aef1-8b6e-4aff-b9b9-b0595d2bbfc7 Sep 01 08:24:28 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:28 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0c37ab41-3bbe-491c-a534-16e89e567576 tempest-GroupsV314Test-1527957971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d265aef1-8b6e-4aff-b9b9-b0595d2bbfc7" returned: 0 in 0.397s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0c37ab41-3bbe-491c-a534-16e89e567576 tempest-GroupsV314Test-1527957971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d265aef1-8b6e-4aff-b9b9-b0595d2bbfc7 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:28 devstack sudo[99100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d265aef1-8b6e-4aff-b9b9-b0595d2bbfc7 Sep 01 08:24:28 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:29 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0c37ab41-3bbe-491c-a534-16e89e567576 tempest-GroupsV314Test-1527957971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d265aef1-8b6e-4aff-b9b9-b0595d2bbfc7" returned: 0 in 0.259s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:29 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0c37ab41-3bbe-491c-a534-16e89e567576 tempest-GroupsV314Test-1527957971 None] Lock "cinder-quobyte-d265aef1-8b6e-4aff-b9b9-b0595d2bbfc7" released by "delete_volume" :: held 0.702s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:29 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-0c37ab41-3bbe-491c-a534-16e89e567576 tempest-GroupsV314Test-1527957971 None] Created reservations ['498fb305-3ae0-4cd6-94a4-e207b47a4a55'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:24:29 devstack cinder-volume[86893]: WARNING cinder.quota [None req-0c37ab41-3bbe-491c-a534-16e89e567576 tempest-GroupsV314Test-1527957971 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-246151730 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-246151730, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:24:29 devstack cinder-volume[86893]: WARNING cinder.quota [None req-0c37ab41-3bbe-491c-a534-16e89e567576 tempest-GroupsV314Test-1527957971 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-246151730 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-246151730, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:24:29 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-0c37ab41-3bbe-491c-a534-16e89e567576 tempest-GroupsV314Test-1527957971 None] Created reservations ['19024da0-56e4-4e73-bff0-cb7d0a777635', 'c4b8208c-f531-4eaf-8d5f-737ed6277d1f', '532aa7fe-f029-4d82-91d3-507f01fc0b21', 'cf37831a-de40-42a0-9cda-a877dd545b09'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:24:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0c37ab41-3bbe-491c-a534-16e89e567576 tempest-GroupsV314Test-1527957971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:24:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0c37ab41-3bbe-491c-a534-16e89e567576 tempest-GroupsV314Test-1527957971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:24:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0c37ab41-3bbe-491c-a534-16e89e567576 tempest-GroupsV314Test-1527957971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:24:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0c37ab41-3bbe-491c-a534-16e89e567576 tempest-GroupsV314Test-1527957971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:24:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0c37ab41-3bbe-491c-a534-16e89e567576 tempest-GroupsV314Test-1527957971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:24:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0c37ab41-3bbe-491c-a534-16e89e567576 tempest-GroupsV314Test-1527957971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:29 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:24:29 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:29 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0c37ab41-3bbe-491c-a534-16e89e567576 tempest-GroupsV314Test-1527957971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.254s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:29 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-0c37ab41-3bbe-491c-a534-16e89e567576 tempest-GroupsV314Test-1527957971 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:24:29 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-0c37ab41-3bbe-491c-a534-16e89e567576 tempest-GroupsV314Test-1527957971 None] Delete group completed successfully. Sep 01 08:24:29 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3fbcefce-50ef-48b0-837c-d9102bfdd604 tempest-GroupsV314Test-1527957971 None] Acquiring lock "cinder-quobyte-45d756e9-99f3-4a58-9c8c-219ee167de84" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:30 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3fbcefce-50ef-48b0-837c-d9102bfdd604 tempest-GroupsV314Test-1527957971 None] Lock "cinder-quobyte-45d756e9-99f3-4a58-9c8c-219ee167de84" acquired by "delete_volume" :: waited 0.026s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:30 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd64b8b-d947-4a1b-92a6-5abac8a4cf2a]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:24:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3fbcefce-50ef-48b0-837c-d9102bfdd604 tempest-GroupsV314Test-1527957971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:30 devstack sudo[99106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84 Sep 01 08:24:30 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:30 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3fbcefce-50ef-48b0-837c-d9102bfdd604 tempest-GroupsV314Test-1527957971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84" returned: 0 in 0.366s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3fbcefce-50ef-48b0-837c-d9102bfdd604 tempest-GroupsV314Test-1527957971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:30 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84 Sep 01 08:24:30 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:30 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3fbcefce-50ef-48b0-837c-d9102bfdd604 tempest-GroupsV314Test-1527957971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-45d756e9-99f3-4a58-9c8c-219ee167de84" returned: 0 in 0.271s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:30 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3fbcefce-50ef-48b0-837c-d9102bfdd604 tempest-GroupsV314Test-1527957971 None] Lock "cinder-quobyte-45d756e9-99f3-4a58-9c8c-219ee167de84" released by "delete_volume" :: held 0.705s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:30 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-3fbcefce-50ef-48b0-837c-d9102bfdd604 tempest-GroupsV314Test-1527957971 None] Created reservations ['af5298ec-2e0c-4f30-97f7-0e27ab730743'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:24:30 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-3fbcefce-50ef-48b0-837c-d9102bfdd604 tempest-GroupsV314Test-1527957971 None] Created reservations ['ed6c8872-f235-4eea-b8ff-8ccec3155939', '2467624c-6097-4821-887c-8122c538f6a9', '01c65d1c-c11a-4d47-80cc-0b2b31fec9d3', '4ad10a3e-266b-4c5a-a572-b623061edf51'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:24:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3fbcefce-50ef-48b0-837c-d9102bfdd604 tempest-GroupsV314Test-1527957971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:24:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3fbcefce-50ef-48b0-837c-d9102bfdd604 tempest-GroupsV314Test-1527957971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:24:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3fbcefce-50ef-48b0-837c-d9102bfdd604 tempest-GroupsV314Test-1527957971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:24:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3fbcefce-50ef-48b0-837c-d9102bfdd604 tempest-GroupsV314Test-1527957971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:24:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3fbcefce-50ef-48b0-837c-d9102bfdd604 tempest-GroupsV314Test-1527957971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:24:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3fbcefce-50ef-48b0-837c-d9102bfdd604 tempest-GroupsV314Test-1527957971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:30 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:24:30 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:24:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:24:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:24:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:24:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:24:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:24:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:31 devstack sudo[99116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:24:31 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:31 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3fbcefce-50ef-48b0-837c-d9102bfdd604 tempest-GroupsV314Test-1527957971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.266s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:31 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-3fbcefce-50ef-48b0-837c-d9102bfdd604 tempest-GroupsV314Test-1527957971 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:24:31 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-3fbcefce-50ef-48b0-837c-d9102bfdd604 tempest-GroupsV314Test-1527957971 None] Delete group completed successfully. Sep 01 08:24:31 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.296s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:31 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:24:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager._thread_info {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:24:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread count: 28 {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 08:24:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread info: [<_MainThread(MainThread, started 138934582050944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 08:24:33 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:24:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] Flow 'volume_create_manager' (58d6e8e8-fdc5-4a1a-9c92-6c4e76c808c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:24:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2033876e-c6e2-44f6-8156-327dfa09792a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:24:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2033876e-c6e2-44f6-8156-327dfa09792a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1379850793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a1ee3f2-2147-47d5-97a9-428a160f792a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2791e333d42448daaa0b2d6a70969de1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:24:33Z,use_quota=True,user_id='d0141f68190b4c178932a066e3de69d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:24:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b22bac-c7a2-449a-8c59-72f2af35ef78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:24:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b22bac-c7a2-449a-8c59-72f2af35ef78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:24:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4711a8cb-07db-4696-a890-996021658a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:24:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4711a8cb-07db-4696-a890-996021658a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a1ee3f2-2147-47d5-97a9-428a160f792a', 'volume_name': 'volume-8a1ee3f2-2147-47d5-97a9-428a160f792a', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:24:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1161a372-1757-4b7b-ab1c-2e89bfe82cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:24:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1161a372-1757-4b7b-ab1c-2e89bfe82cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:24:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c0ae322-8007-4e12-9b3f-35f1fc9e9f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:24:33 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] Volume 8a1ee3f2-2147-47d5-97a9-428a160f792a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a1ee3f2-2147-47d5-97a9-428a160f792a', 'volume_size': 1} Sep 01 08:24:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:24:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:24:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1379850793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a1ee3f2-2147-47d5-97a9-428a160f792a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2791e333d42448daaa0b2d6a70969de1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:24:33Z,use_quota=True,user_id='d0141f68190b4c178932a066e3de69d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:24:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] Creating volume 8a1ee3f2-2147-47d5-97a9-428a160f792a {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:24:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:24:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:24:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:24:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:24:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:24:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:24:33 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:24:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8a1ee3f2-2147-47d5-97a9-428a160f792a 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:33 devstack sudo[99120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8a1ee3f2-2147-47d5-97a9-428a160f792a 1073741824 Sep 01 08:24:33 devstack sudo[99120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:33 devstack sudo[99120]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8a1ee3f2-2147-47d5-97a9-428a160f792a 1073741824" returned: 0 in 0.467s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8a1ee3f2-2147-47d5-97a9-428a160f792a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:33 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8a1ee3f2-2147-47d5-97a9-428a160f792a Sep 01 08:24:33 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:34 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8a1ee3f2-2147-47d5-97a9-428a160f792a" returned: 0 in 0.267s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:24:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:24:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c0ae322-8007-4e12-9b3f-35f1fc9e9f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a1ee3f2-2147-47d5-97a9-428a160f792a', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:24:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02faec75-7ec6-4dc7-bd6a-f9fe62bb99a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:24:34 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] Volume volume-8a1ee3f2-2147-47d5-97a9-428a160f792a (8a1ee3f2-2147-47d5-97a9-428a160f792a): created successfully Sep 01 08:24:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02faec75-7ec6-4dc7-bd6a-f9fe62bb99a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:24:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] Flow 'volume_create_manager' (58d6e8e8-fdc5-4a1a-9c92-6c4e76c808c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:24:34 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-637f7ee5-bf9d-4bf8-b786-7df9e6bbf743 tempest-VolumeQuotasAdminTestJSON-305091179 None] Created volume successfully. Sep 01 08:24:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6673524c-a21b-459f-ac1c-80f067971502 tempest-VolumeQuotasAdminTestJSON-305091179 None] Acquiring lock "cinder-8a1ee3f2-2147-47d5-97a9-428a160f792a-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6673524c-a21b-459f-ac1c-80f067971502 tempest-VolumeQuotasAdminTestJSON-305091179 None] Lock "cinder-8a1ee3f2-2147-47d5-97a9-428a160f792a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6673524c-a21b-459f-ac1c-80f067971502 tempest-VolumeQuotasAdminTestJSON-305091179 None] Acquiring lock "cinder-quobyte-8a1ee3f2-2147-47d5-97a9-428a160f792a" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6673524c-a21b-459f-ac1c-80f067971502 tempest-VolumeQuotasAdminTestJSON-305091179 None] Lock "cinder-quobyte-8a1ee3f2-2147-47d5-97a9-428a160f792a" acquired by "delete_volume" :: waited 0.021s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:35 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2f612d-189e-438b-88ba-bbe703e4e354]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:24:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6673524c-a21b-459f-ac1c-80f067971502 tempest-VolumeQuotasAdminTestJSON-305091179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8a1ee3f2-2147-47d5-97a9-428a160f792a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:35 devstack sudo[99129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8a1ee3f2-2147-47d5-97a9-428a160f792a Sep 01 08:24:35 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:35 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6673524c-a21b-459f-ac1c-80f067971502 tempest-VolumeQuotasAdminTestJSON-305091179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8a1ee3f2-2147-47d5-97a9-428a160f792a" returned: 0 in 0.377s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6673524c-a21b-459f-ac1c-80f067971502 tempest-VolumeQuotasAdminTestJSON-305091179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8a1ee3f2-2147-47d5-97a9-428a160f792a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:35 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8a1ee3f2-2147-47d5-97a9-428a160f792a Sep 01 08:24:35 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:36 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6673524c-a21b-459f-ac1c-80f067971502 tempest-VolumeQuotasAdminTestJSON-305091179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8a1ee3f2-2147-47d5-97a9-428a160f792a" returned: 0 in 0.270s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6673524c-a21b-459f-ac1c-80f067971502 tempest-VolumeQuotasAdminTestJSON-305091179 None] Lock "cinder-quobyte-8a1ee3f2-2147-47d5-97a9-428a160f792a" released by "delete_volume" :: held 0.690s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-6673524c-a21b-459f-ac1c-80f067971502 tempest-VolumeQuotasAdminTestJSON-305091179 None] Created reservations ['392a9332-6bcb-408a-aefc-dabc14efdf60', '44e4101a-1c92-4228-8a44-3603349862fc', 'ead65937-5164-41c6-964a-0aa9e417bc15', 'ebd345f8-0929-4c64-a064-38388fe66510'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6673524c-a21b-459f-ac1c-80f067971502 tempest-VolumeQuotasAdminTestJSON-305091179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6673524c-a21b-459f-ac1c-80f067971502 tempest-VolumeQuotasAdminTestJSON-305091179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6673524c-a21b-459f-ac1c-80f067971502 tempest-VolumeQuotasAdminTestJSON-305091179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6673524c-a21b-459f-ac1c-80f067971502 tempest-VolumeQuotasAdminTestJSON-305091179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6673524c-a21b-459f-ac1c-80f067971502 tempest-VolumeQuotasAdminTestJSON-305091179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6673524c-a21b-459f-ac1c-80f067971502 tempest-VolumeQuotasAdminTestJSON-305091179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:36 devstack sudo[99137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:24:36 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Flow 'volume_create_manager' (d2cce3f1-ad66-4623-b868-a0e74d3ac2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4b60b6-c7a8-478d-820b-921fa7b5ce93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4b60b6-c7a8-478d-820b-921fa7b5ce93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-585292714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54cf8615-ded3-462b-8133-02436ad50360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7631e0b61a94f25b7b776b1cfc0b9a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:24:37Z,use_quota=True,user_id='6a4a5fad8b8244c9aa31273b49df8aa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee459e93-4c62-4f59-911b-6f16ef5a74b8),volume_type_id=ee459e93-4c62-4f59-911b-6f16ef5a74b8)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15bdaaaf-4f7d-4b75-aab9-2c0d831841f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15bdaaaf-4f7d-4b75-aab9-2c0d831841f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:24:36 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (046bf671-14ed-4081-98f4-52cfc43a1b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (046bf671-14ed-4081-98f4-52cfc43a1b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54cf8615-ded3-462b-8133-02436ad50360', 'volume_name': 'volume-54cf8615-ded3-462b-8133-02436ad50360', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce5a233f-50c2-4fb6-b6c2-1c0617cbb8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce5a233f-50c2-4fb6-b6c2-1c0617cbb8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (583b3ab5-4c5d-49be-9581-4769f2c0e491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:24:36 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Volume 54cf8615-ded3-462b-8133-02436ad50360: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54cf8615-ded3-462b-8133-02436ad50360', 'volume_size': 1} Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-585292714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54cf8615-ded3-462b-8133-02436ad50360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7631e0b61a94f25b7b776b1cfc0b9a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:24:37Z,use_quota=True,user_id='6a4a5fad8b8244c9aa31273b49df8aa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee459e93-4c62-4f59-911b-6f16ef5a74b8),volume_type_id=ee459e93-4c62-4f59-911b-6f16ef5a74b8)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Creating volume 54cf8615-ded3-462b-8133-02436ad50360 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:24:36 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-54cf8615-ded3-462b-8133-02436ad50360 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6673524c-a21b-459f-ac1c-80f067971502 tempest-VolumeQuotasAdminTestJSON-305091179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.316s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-6673524c-a21b-459f-ac1c-80f067971502 tempest-VolumeQuotasAdminTestJSON-305091179 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:24:36 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-6673524c-a21b-459f-ac1c-80f067971502 tempest-VolumeQuotasAdminTestJSON-305091179 None] Deleted volume successfully. Sep 01 08:24:36 devstack sudo[99140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-54cf8615-ded3-462b-8133-02436ad50360 1073741824 Sep 01 08:24:36 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:36 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6673524c-a21b-459f-ac1c-80f067971502 tempest-VolumeQuotasAdminTestJSON-305091179 None] Lock "cinder-8a1ee3f2-2147-47d5-97a9-428a160f792a-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:37 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-54cf8615-ded3-462b-8133-02436ad50360 1073741824" returned: 0 in 0.473s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] Flow 'volume_create_manager' (5deead3e-c2b3-4676-a419-f64895baa54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d88e68-3c47-48f8-9503-2540fbba35ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d88e68-3c47-48f8-9503-2540fbba35ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1976058559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56515cdd-31b2-4ab5-9182-faeb39ad10c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2791e333d42448daaa0b2d6a70969de1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:24:37Z,use_quota=True,user_id='d0141f68190b4c178932a066e3de69d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c250360-cc22-48bb-a33b-d4da19f053a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c250360-cc22-48bb-a33b-d4da19f053a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf78db9-2920-493b-8a8f-1bae6811e86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf78db9-2920-493b-8a8f-1bae6811e86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56515cdd-31b2-4ab5-9182-faeb39ad10c5', 'volume_name': 'volume-56515cdd-31b2-4ab5-9182-faeb39ad10c5', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0395b8a8-e1fa-44a0-91ac-70e7c04d8a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0395b8a8-e1fa-44a0-91ac-70e7c04d8a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e95627-e251-422b-86a0-e433d8aa87b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:24:37 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] Volume 56515cdd-31b2-4ab5-9182-faeb39ad10c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56515cdd-31b2-4ab5-9182-faeb39ad10c5', 'volume_size': 1} Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-54cf8615-ded3-462b-8133-02436ad50360 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:37 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-54cf8615-ded3-462b-8133-02436ad50360 Sep 01 08:24:37 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:37 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-54cf8615-ded3-462b-8133-02436ad50360" returned: 0 in 0.246s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.262s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1976058559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56515cdd-31b2-4ab5-9182-faeb39ad10c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2791e333d42448daaa0b2d6a70969de1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:24:37Z,use_quota=True,user_id='d0141f68190b4c178932a066e3de69d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] Creating volume 56515cdd-31b2-4ab5-9182-faeb39ad10c5 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:24:37 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-56515cdd-31b2-4ab5-9182-faeb39ad10c5 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:37 devstack sudo[99150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-56515cdd-31b2-4ab5-9182-faeb39ad10c5 1073741824 Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (583b3ab5-4c5d-49be-9581-4769f2c0e491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54cf8615-ded3-462b-8133-02436ad50360', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:24:37 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7375af1-6297-4030-ad8e-f4d707d4e598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:24:37 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Volume volume-54cf8615-ded3-462b-8133-02436ad50360 (54cf8615-ded3-462b-8133-02436ad50360): created successfully Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7375af1-6297-4030-ad8e-f4d707d4e598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Flow 'volume_create_manager' (d2cce3f1-ad66-4623-b868-a0e74d3ac2a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:24:37 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-c2796234-6aa4-48e5-9e5e-6ac76f57238f tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Created volume successfully. Sep 01 08:24:37 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-56515cdd-31b2-4ab5-9182-faeb39ad10c5 1073741824" returned: 0 in 0.392s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-56515cdd-31b2-4ab5-9182-faeb39ad10c5 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:37 devstack sudo[99155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-56515cdd-31b2-4ab5-9182-faeb39ad10c5 Sep 01 08:24:37 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:38 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-56515cdd-31b2-4ab5-9182-faeb39ad10c5" returned: 0 in 0.238s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] <== create_volume: return (664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:24:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.667s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:24:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e95627-e251-422b-86a0-e433d8aa87b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56515cdd-31b2-4ab5-9182-faeb39ad10c5', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:24:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbaecce1-b958-418d-9aca-aec25a49d286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:24:38 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] Volume volume-56515cdd-31b2-4ab5-9182-faeb39ad10c5 (56515cdd-31b2-4ab5-9182-faeb39ad10c5): created successfully Sep 01 08:24:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbaecce1-b958-418d-9aca-aec25a49d286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:24:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] Flow 'volume_create_manager' (5deead3e-c2b3-4676-a419-f64895baa54c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:24:38 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-4f4e43f1-70ad-4597-9f0e-3ac9de39b9f6 tempest-VolumeQuotasAdminTestJSON-305091179 None] Created volume successfully. Sep 01 08:24:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e86ec1c5-60d2-4817-a61c-2c3f76a2786e tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:24:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e86ec1c5-60d2-4817-a61c-2c3f76a2786e tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:24:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e86ec1c5-60d2-4817-a61c-2c3f76a2786e tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:24:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e86ec1c5-60d2-4817-a61c-2c3f76a2786e tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:24:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e86ec1c5-60d2-4817-a61c-2c3f76a2786e tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:24:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e86ec1c5-60d2-4817-a61c-2c3f76a2786e tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:38 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:24:38 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:39 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e86ec1c5-60d2-4817-a61c-2c3f76a2786e tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.254s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:39 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-e86ec1c5-60d2-4817-a61c-2c3f76a2786e tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:24:39 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-e86ec1c5-60d2-4817-a61c-2c3f76a2786e tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Retype volume completed successfully. Sep 01 08:24:39 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-279a3421-17d7-4951-b6a3-37756f021e2c tempest-VolumeQuotasAdminTestJSON-1403507608 None] Transfer volume completed successfully. Sep 01 08:24:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7762c9ac-6398-4393-8041-b8455529ebc9 tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Acquiring lock "cinder-54cf8615-ded3-462b-8133-02436ad50360-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7762c9ac-6398-4393-8041-b8455529ebc9 tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Lock "cinder-54cf8615-ded3-462b-8133-02436ad50360-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3404b70d-feeb-4d3d-ba98-724773ac18b2 tempest-VolumeQuotasAdminTestJSON-596112998 None] Acquiring lock "cinder-56515cdd-31b2-4ab5-9182-faeb39ad10c5-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7762c9ac-6398-4393-8041-b8455529ebc9 tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Acquiring lock "cinder-quobyte-54cf8615-ded3-462b-8133-02436ad50360" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3404b70d-feeb-4d3d-ba98-724773ac18b2 tempest-VolumeQuotasAdminTestJSON-596112998 None] Lock "cinder-56515cdd-31b2-4ab5-9182-faeb39ad10c5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7762c9ac-6398-4393-8041-b8455529ebc9 tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Lock "cinder-quobyte-54cf8615-ded3-462b-8133-02436ad50360" acquired by "delete_volume" :: waited 0.019s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:40 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a3a25c-b8aa-4a74-b702-1a02058253cc]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:24:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7762c9ac-6398-4393-8041-b8455529ebc9 tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-54cf8615-ded3-462b-8133-02436ad50360 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3404b70d-feeb-4d3d-ba98-724773ac18b2 tempest-VolumeQuotasAdminTestJSON-596112998 None] Acquiring lock "cinder-quobyte-56515cdd-31b2-4ab5-9182-faeb39ad10c5" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3404b70d-feeb-4d3d-ba98-724773ac18b2 tempest-VolumeQuotasAdminTestJSON-596112998 None] Lock "cinder-quobyte-56515cdd-31b2-4ab5-9182-faeb39ad10c5" acquired by "delete_volume" :: waited 0.024s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:40 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[85816605-cc47-47c4-915c-f2402b6382ab]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:24:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3404b70d-feeb-4d3d-ba98-724773ac18b2 tempest-VolumeQuotasAdminTestJSON-596112998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-56515cdd-31b2-4ab5-9182-faeb39ad10c5 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:40 devstack sudo[99161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-54cf8615-ded3-462b-8133-02436ad50360 Sep 01 08:24:40 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:40 devstack sudo[99162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-56515cdd-31b2-4ab5-9182-faeb39ad10c5 Sep 01 08:24:40 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:40 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7762c9ac-6398-4393-8041-b8455529ebc9 tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-54cf8615-ded3-462b-8133-02436ad50360" returned: 0 in 0.371s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7762c9ac-6398-4393-8041-b8455529ebc9 tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-54cf8615-ded3-462b-8133-02436ad50360 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:40 devstack sudo[99170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-54cf8615-ded3-462b-8133-02436ad50360 Sep 01 08:24:40 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:40 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3404b70d-feeb-4d3d-ba98-724773ac18b2 tempest-VolumeQuotasAdminTestJSON-596112998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-56515cdd-31b2-4ab5-9182-faeb39ad10c5" returned: 0 in 0.376s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3404b70d-feeb-4d3d-ba98-724773ac18b2 tempest-VolumeQuotasAdminTestJSON-596112998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-56515cdd-31b2-4ab5-9182-faeb39ad10c5 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:40 devstack sudo[99173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-56515cdd-31b2-4ab5-9182-faeb39ad10c5 Sep 01 08:24:40 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:40 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7762c9ac-6398-4393-8041-b8455529ebc9 tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-54cf8615-ded3-462b-8133-02436ad50360" returned: 0 in 0.255s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7762c9ac-6398-4393-8041-b8455529ebc9 tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Lock "cinder-quobyte-54cf8615-ded3-462b-8133-02436ad50360" released by "delete_volume" :: held 0.675s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:40 devstack cinder-volume[86893]: WARNING cinder.quota [None req-7762c9ac-6398-4393-8041-b8455529ebc9 tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:24:40 devstack cinder-volume[86893]: WARNING cinder.quota [None req-7762c9ac-6398-4393-8041-b8455529ebc9 tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:24:40 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3404b70d-feeb-4d3d-ba98-724773ac18b2 tempest-VolumeQuotasAdminTestJSON-596112998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-56515cdd-31b2-4ab5-9182-faeb39ad10c5" returned: 0 in 0.243s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:41 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3404b70d-feeb-4d3d-ba98-724773ac18b2 tempest-VolumeQuotasAdminTestJSON-596112998 None] Lock "cinder-quobyte-56515cdd-31b2-4ab5-9182-faeb39ad10c5" released by "delete_volume" :: held 0.658s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:41 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-7762c9ac-6398-4393-8041-b8455529ebc9 tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Created reservations ['fd6c40ec-75ce-4188-90ce-c72571c90351', 'f9ae3605-d884-4534-8cf5-ca8ad9cabc9a', 'b9ac5f40-f837-40e7-931e-f23ec818b790', 'abbebbaa-5cf8-4cea-873a-33a5d6baf0c9'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:24:41 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-3404b70d-feeb-4d3d-ba98-724773ac18b2 tempest-VolumeQuotasAdminTestJSON-596112998 None] Created reservations ['601f5052-c2c4-411c-a2ec-69e08809118f', 'ec200293-51a2-4eba-964b-1d2207185e99', 'fd0cb147-f74b-434f-b9fc-682810a02021', '474a876c-8e7f-4aa4-9fff-4461fb4efcdf'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:24:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7762c9ac-6398-4393-8041-b8455529ebc9 tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:24:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7762c9ac-6398-4393-8041-b8455529ebc9 tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:24:41 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7762c9ac-6398-4393-8041-b8455529ebc9 tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:24:41 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7762c9ac-6398-4393-8041-b8455529ebc9 tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:24:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7762c9ac-6398-4393-8041-b8455529ebc9 tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:24:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7762c9ac-6398-4393-8041-b8455529ebc9 tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:41 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:24:41 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3404b70d-feeb-4d3d-ba98-724773ac18b2 tempest-VolumeQuotasAdminTestJSON-596112998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:24:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3404b70d-feeb-4d3d-ba98-724773ac18b2 tempest-VolumeQuotasAdminTestJSON-596112998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:24:41 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3404b70d-feeb-4d3d-ba98-724773ac18b2 tempest-VolumeQuotasAdminTestJSON-596112998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:24:41 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3404b70d-feeb-4d3d-ba98-724773ac18b2 tempest-VolumeQuotasAdminTestJSON-596112998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:24:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3404b70d-feeb-4d3d-ba98-724773ac18b2 tempest-VolumeQuotasAdminTestJSON-596112998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:24:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3404b70d-feeb-4d3d-ba98-724773ac18b2 tempest-VolumeQuotasAdminTestJSON-596112998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:41 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:24:41 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:41 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7762c9ac-6398-4393-8041-b8455529ebc9 tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.255s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:41 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-7762c9ac-6398-4393-8041-b8455529ebc9 tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:24:41 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-7762c9ac-6398-4393-8041-b8455529ebc9 tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Deleted volume successfully. Sep 01 08:24:41 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7762c9ac-6398-4393-8041-b8455529ebc9 tempest-VolumeRetypeWithoutMigrationTest-1216077406 None] Lock "cinder-54cf8615-ded3-462b-8133-02436ad50360-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:41 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3404b70d-feeb-4d3d-ba98-724773ac18b2 tempest-VolumeQuotasAdminTestJSON-596112998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.288s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:41 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-3404b70d-feeb-4d3d-ba98-724773ac18b2 tempest-VolumeQuotasAdminTestJSON-596112998 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:24:41 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-3404b70d-feeb-4d3d-ba98-724773ac18b2 tempest-VolumeQuotasAdminTestJSON-596112998 None] Deleted volume successfully. Sep 01 08:24:41 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3404b70d-feeb-4d3d-ba98-724773ac18b2 tempest-VolumeQuotasAdminTestJSON-596112998 None] Lock "cinder-56515cdd-31b2-4ab5-9182-faeb39ad10c5-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:51 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:UPDATE=112,cinder:SELECT=109,cinder:DELETE=7,cinder:INSERT=30 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:24:51 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=93,cinder:UPDATE=121,cinder:INSERT=27,cinder:DELETE=5 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:24:53 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:24:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Flow 'volume_create_manager' (05eb7d8e-e5ce-4453-a1af-e3762a8daeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:24:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a09a617-d12e-4c1c-a35f-2aabf65f27f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:24:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a09a617-d12e-4c1c-a35f-2aabf65f27f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-71210173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd1a3afb-df9a-4aab-ab2e-6d8392984d95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55bc607613164d489f762f279e58ed70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:24:53Z,use_quota=True,user_id='7acd7ce474d64a6182d4e3904bf7cff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:24:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583f6613-550c-4a1d-a5a2-632382e6c0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:24:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583f6613-550c-4a1d-a5a2-632382e6c0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:24:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad3465a1-c243-49e0-a5d9-75186e9ec024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:24:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad3465a1-c243-49e0-a5d9-75186e9ec024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd1a3afb-df9a-4aab-ab2e-6d8392984d95', 'volume_name': 'volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:24:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c6b83e-c4f8-477e-8c22-19032bfb6956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:24:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c6b83e-c4f8-477e-8c22-19032bfb6956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:24:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eb155f6-beb4-483b-942f-54e1d7cf607d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:24:53 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Volume bd1a3afb-df9a-4aab-ab2e-6d8392984d95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95', 'volume_size': 1} Sep 01 08:24:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:24:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:24:53 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-71210173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd1a3afb-df9a-4aab-ab2e-6d8392984d95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55bc607613164d489f762f279e58ed70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:24:53Z,use_quota=True,user_id='7acd7ce474d64a6182d4e3904bf7cff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:24:53 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Creating volume bd1a3afb-df9a-4aab-ab2e-6d8392984d95 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:24:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:24:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:24:53 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:24:53 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:24:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:24:53 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:24:53 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:24:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:53 devstack sudo[99185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95 1073741824 Sep 01 08:24:53 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:53 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95 1073741824" returned: 0 in 0.424s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:53 devstack sudo[99191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95 Sep 01 08:24:53 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:53 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95" returned: 0 in 0.257s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:53 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:24:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:24:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eb155f6-beb4-483b-942f-54e1d7cf607d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:24:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (194283c2-2787-4c51-9d7c-ae63e4202479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:24:53 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Volume volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95 (bd1a3afb-df9a-4aab-ab2e-6d8392984d95): created successfully Sep 01 08:24:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (194283c2-2787-4c51-9d7c-ae63e4202479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:24:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Flow 'volume_create_manager' (05eb7d8e-e5ce-4453-a1af-e3762a8daeca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:24:53 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-135d71ee-38e3-497d-9e6a-4509413bea8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Created volume successfully. Sep 01 08:24:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-efc424a2-5009-4249-92cd-9e8a79984f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:24:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-efc424a2-5009-4249-92cd-9e8a79984f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:24:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-efc424a2-5009-4249-92cd-9e8a79984f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Creating offline snapshot be903738-91e2-46fb-be76-0d267c7d2b6a of volume bd1a3afb-df9a-4aab-ab2e-6d8392984d95 {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:24:54 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[2467968c-e1e6-411d-8ef2-ce13b2289643]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:24:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-efc424a2-5009-4249-92cd-9e8a79984f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:54 devstack sudo[99194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95 Sep 01 08:24:54 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:54 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-efc424a2-5009-4249-92cd-9e8a79984f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95" returned: 0 in 0.353s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-efc424a2-5009-4249-92cd-9e8a79984f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95.be903738-91e2-46fb-be76-0d267c7d2b6a 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:54 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95.be903738-91e2-46fb-be76-0d267c7d2b6a 1G Sep 01 08:24:54 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:55 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-efc424a2-5009-4249-92cd-9e8a79984f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95.be903738-91e2-46fb-be76-0d267c7d2b6a 1G" returned: 0 in 0.510s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-efc424a2-5009-4249-92cd-9e8a79984f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95.be903738-91e2-46fb-be76-0d267c7d2b6a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:55 devstack sudo[99208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95.be903738-91e2-46fb-be76-0d267c7d2b6a Sep 01 08:24:55 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:55 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-efc424a2-5009-4249-92cd-9e8a79984f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95.be903738-91e2-46fb-be76-0d267c7d2b6a" returned: 0 in 0.310s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:55 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-efc424a2-5009-4249-92cd-9e8a79984f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95.be903738-91e2-46fb-be76-0d267c7d2b6a is being set with open permissions: ugo+rw Sep 01 08:24:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-efc424a2-5009-4249-92cd-9e8a79984f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95.be903738-91e2-46fb-be76-0d267c7d2b6a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:55 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95.be903738-91e2-46fb-be76-0d267c7d2b6a Sep 01 08:24:55 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:55 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-efc424a2-5009-4249-92cd-9e8a79984f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95.be903738-91e2-46fb-be76-0d267c7d2b6a" returned: 0 in 0.248s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-efc424a2-5009-4249-92cd-9e8a79984f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:55 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95.info Sep 01 08:24:55 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:56 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-efc424a2-5009-4249-92cd-9e8a79984f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95.info" returned: 0 in 0.281s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:56 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-efc424a2-5009-4249-92cd-9e8a79984f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95.info is being set with open permissions: ugo+rw Sep 01 08:24:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-efc424a2-5009-4249-92cd-9e8a79984f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:56 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95.info Sep 01 08:24:56 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:56 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-efc424a2-5009-4249-92cd-9e8a79984f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95.info" returned: 0 in 0.275s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-efc424a2-5009-4249-92cd-9e8a79984f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.079s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:24:56 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-efc424a2-5009-4249-92cd-9e8a79984f8e tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Create snapshot completed successfully Sep 01 08:24:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-811ea7d8-dc82-4c0e-9542-600a63750d23 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Acquiring lock "cinder-be903738-91e2-46fb-be76-0d267c7d2b6a-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-811ea7d8-dc82-4c0e-9542-600a63750d23 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Lock "cinder-be903738-91e2-46fb-be76-0d267c7d2b6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-811ea7d8-dc82-4c0e-9542-600a63750d23 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Acquiring lock "cinder-quobyte-bd1a3afb-df9a-4aab-ab2e-6d8392984d95" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-811ea7d8-dc82-4c0e-9542-600a63750d23 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Lock "cinder-quobyte-bd1a3afb-df9a-4aab-ab2e-6d8392984d95" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-811ea7d8-dc82-4c0e-9542-600a63750d23 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Acquiring lock "cinder-quobyte-be903738-91e2-46fb-be76-0d267c7d2b6a" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:24:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-811ea7d8-dc82-4c0e-9542-600a63750d23 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Lock "cinder-quobyte-be903738-91e2-46fb-be76-0d267c7d2b6a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:24:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-811ea7d8-dc82-4c0e-9542-600a63750d23 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Deleting offline snapshot be903738-91e2-46fb-be76-0d267c7d2b6a of volume bd1a3afb-df9a-4aab-ab2e-6d8392984d95 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:24:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-811ea7d8-dc82-4c0e-9542-600a63750d23 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] snapshot_file for this snap is: volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95.be903738-91e2-46fb-be76-0d267c7d2b6a {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:24:58 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fdcbc9-536d-42cf-aeb5-46cd0d22cb2e]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:24:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-811ea7d8-dc82-4c0e-9542-600a63750d23 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95.be903738-91e2-46fb-be76-0d267c7d2b6a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:58 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95.be903738-91e2-46fb-be76-0d267c7d2b6a Sep 01 08:24:58 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:58 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-811ea7d8-dc82-4c0e-9542-600a63750d23 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95.be903738-91e2-46fb-be76-0d267c7d2b6a" returned: 0 in 0.375s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-811ea7d8-dc82-4c0e-9542-600a63750d23 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:24:58 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[6472718e-8729-4ff3-a9bd-2107a48b09b5]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:24:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-811ea7d8-dc82-4c0e-9542-600a63750d23 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:58 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95 Sep 01 08:24:58 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:58 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-811ea7d8-dc82-4c0e-9542-600a63750d23 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95" returned: 0 in 0.462s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-811ea7d8-dc82-4c0e-9542-600a63750d23 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95.be903738-91e2-46fb-be76-0d267c7d2b6a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:58 devstack sudo[99235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95.be903738-91e2-46fb-be76-0d267c7d2b6a Sep 01 08:24:58 devstack sudo[99235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:59 devstack sudo[99235]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-811ea7d8-dc82-4c0e-9542-600a63750d23 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95.be903738-91e2-46fb-be76-0d267c7d2b6a" returned: 0 in 0.389s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-811ea7d8-dc82-4c0e-9542-600a63750d23 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95.be903738-91e2-46fb-be76-0d267c7d2b6a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:24:59 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95.be903738-91e2-46fb-be76-0d267c7d2b6a Sep 01 08:24:59 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:24:59 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Sep 01 08:24:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-811ea7d8-dc82-4c0e-9542-600a63750d23 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95.be903738-91e2-46fb-be76-0d267c7d2b6a" returned: 0 in 0.269s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:24:59 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-811ea7d8-dc82-4c0e-9542-600a63750d23 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Lock "cinder-quobyte-be903738-91e2-46fb-be76-0d267c7d2b6a" released by "_delete_snapshot" :: held 1.655s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:59 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-811ea7d8-dc82-4c0e-9542-600a63750d23 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Lock "cinder-quobyte-bd1a3afb-df9a-4aab-ab2e-6d8392984d95" released by "delete_snapshot" :: held 1.677s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:24:59 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-811ea7d8-dc82-4c0e-9542-600a63750d23 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Created reservations ['2b3c25e5-c160-4c3a-b12c-27b507c16b2b', '4711729b-0cb6-4aba-a4c9-6b159fe8efac', '4857042a-859f-42fd-8380-271a03d51a1d', '1f5423b8-41c7-42c2-bd77-0ecafb7a09a1'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:24:59 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-811ea7d8-dc82-4c0e-9542-600a63750d23 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Delete snapshot completed successfully. Sep 01 08:24:59 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-811ea7d8-dc82-4c0e-9542-600a63750d23 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Lock "cinder-be903738-91e2-46fb-be76-0d267c7d2b6a-delete_snapshot" released by "delete_snapshot" :: held 1.830s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:00 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d3511601-b441-49c7-a7dd-dae9c015e066 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Acquiring lock "cinder-bd1a3afb-df9a-4aab-ab2e-6d8392984d95-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:00 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d3511601-b441-49c7-a7dd-dae9c015e066 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Lock "cinder-bd1a3afb-df9a-4aab-ab2e-6d8392984d95-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:00 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d3511601-b441-49c7-a7dd-dae9c015e066 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Acquiring lock "cinder-quobyte-bd1a3afb-df9a-4aab-ab2e-6d8392984d95" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:00 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d3511601-b441-49c7-a7dd-dae9c015e066 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Lock "cinder-quobyte-bd1a3afb-df9a-4aab-ab2e-6d8392984d95" acquired by "delete_volume" :: waited 0.014s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:00 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdc6422-a8a0-4631-afad-ada7ef09fbcc]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:25:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d3511601-b441-49c7-a7dd-dae9c015e066 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:00 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95 Sep 01 08:25:00 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:00 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d3511601-b441-49c7-a7dd-dae9c015e066 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95" returned: 0 in 0.385s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d3511601-b441-49c7-a7dd-dae9c015e066 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:00 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95 Sep 01 08:25:00 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:00 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d3511601-b441-49c7-a7dd-dae9c015e066 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bd1a3afb-df9a-4aab-ab2e-6d8392984d95" returned: 0 in 0.271s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:00 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d3511601-b441-49c7-a7dd-dae9c015e066 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Lock "cinder-quobyte-bd1a3afb-df9a-4aab-ab2e-6d8392984d95" released by "delete_volume" :: held 0.724s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:01 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-d3511601-b441-49c7-a7dd-dae9c015e066 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Created reservations ['8d8b1c64-80c1-4e49-b3d3-e8539c29ad78', 'f8807e92-9629-4d4e-b3fe-28da1ac047c8', 'af113e1d-71a5-43c5-846f-07a2692fa5f1', '06897e08-c906-4237-b82d-019618b2ef23'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:25:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d3511601-b441-49c7-a7dd-dae9c015e066 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d3511601-b441-49c7-a7dd-dae9c015e066 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:01 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d3511601-b441-49c7-a7dd-dae9c015e066 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:25:01 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d3511601-b441-49c7-a7dd-dae9c015e066 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:25:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d3511601-b441-49c7-a7dd-dae9c015e066 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d3511601-b441-49c7-a7dd-dae9c015e066 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:01 devstack sudo[99254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:25:01 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:01 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d3511601-b441-49c7-a7dd-dae9c015e066 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.264s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:01 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-d3511601-b441-49c7-a7dd-dae9c015e066 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:25:01 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-d3511601-b441-49c7-a7dd-dae9c015e066 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Deleted volume successfully. Sep 01 08:25:01 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d3511601-b441-49c7-a7dd-dae9c015e066 tempest-VolumeSnapshotQuotasNegativeTestJSON-635860766 None] Lock "cinder-bd1a3afb-df9a-4aab-ab2e-6d8392984d95-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:11 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:UPDATE=17,cinder:INSERT=6,cinder:SELECT=15 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:25:11 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=17,cinder:UPDATE=19,cinder:DELETE=3,cinder:INSERT=4 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:25:13 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:25:13 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] Flow 'volume_create_manager' (e0eae03c-5d31-4d5d-a22a-dcfed0165f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:25:13 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3442033-1221-4a59-b07c-5bad9f6cb942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:13 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3442033-1221-4a59-b07c-5bad9f6cb942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-598629127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55f76976-9a61-40f9-ae1f-27cf581d886b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4a2c55c5cf44df5803634726adeb648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:25:14Z,use_quota=True,user_id='4db944126b734da9a7815eb3e3104d1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:13 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (050d7c81-e167-4513-a997-ce9b66d647cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:13 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (050d7c81-e167-4513-a997-ce9b66d647cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:13 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b630073-472c-49a0-b086-2ff7b1c3a1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:13 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b630073-472c-49a0-b086-2ff7b1c3a1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55f76976-9a61-40f9-ae1f-27cf581d886b', 'volume_name': 'volume-55f76976-9a61-40f9-ae1f-27cf581d886b', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:13 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f5fc139-72dd-47e1-95e3-1ecfc949964f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:13 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f5fc139-72dd-47e1-95e3-1ecfc949964f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:13 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa9352e-56b7-4544-ab8a-f9025ef81530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:13 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] Volume 55f76976-9a61-40f9-ae1f-27cf581d886b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55f76976-9a61-40f9-ae1f-27cf581d886b', 'volume_size': 1} Sep 01 08:25:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:13 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-598629127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55f76976-9a61-40f9-ae1f-27cf581d886b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4a2c55c5cf44df5803634726adeb648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:25:14Z,use_quota=True,user_id='4db944126b734da9a7815eb3e3104d1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:25:13 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] Creating volume 55f76976-9a61-40f9-ae1f-27cf581d886b {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:25:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:13 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:25:13 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:25:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:13 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:25:13 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:25:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:13 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b 1073741824 Sep 01 08:25:13 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:14 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b 1073741824" returned: 0 in 0.564s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:14 devstack sudo[99656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b Sep 01 08:25:14 devstack sudo[99656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:14 devstack sudo[99656]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b" returned: 0 in 0.253s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:14 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:25:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa9352e-56b7-4544-ab8a-f9025ef81530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55f76976-9a61-40f9-ae1f-27cf581d886b', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ac5da7-c1eb-42c0-bce9-3da9401b5ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:14 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] Volume volume-55f76976-9a61-40f9-ae1f-27cf581d886b (55f76976-9a61-40f9-ae1f-27cf581d886b): created successfully Sep 01 08:25:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ac5da7-c1eb-42c0-bce9-3da9401b5ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] Flow 'volume_create_manager' (e0eae03c-5d31-4d5d-a22a-dcfed0165f17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:25:14 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-74705fe4-d021-4946-8727-e9a6536ca91a tempest-SnapshotMetadataTestJSON-1575416046 None] Created volume successfully. Sep 01 08:25:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3a1b21e8-0074-41d1-8802-5c612159d13b tempest-SnapshotMetadataTestJSON-1575416046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3a1b21e8-0074-41d1-8802-5c612159d13b tempest-SnapshotMetadataTestJSON-1575416046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-3a1b21e8-0074-41d1-8802-5c612159d13b tempest-SnapshotMetadataTestJSON-1575416046 None] Creating offline snapshot d1632bd8-fb45-460d-8955-e864ad2d8dcf of volume 55f76976-9a61-40f9-ae1f-27cf581d886b {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:25:16 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[662d4b8e-4bc9-4465-95a3-ad42eef59c3b]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:25:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3a1b21e8-0074-41d1-8802-5c612159d13b tempest-SnapshotMetadataTestJSON-1575416046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:16 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b Sep 01 08:25:16 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3a1b21e8-0074-41d1-8802-5c612159d13b tempest-SnapshotMetadataTestJSON-1575416046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b" returned: 0 in 0.520s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3a1b21e8-0074-41d1-8802-5c612159d13b tempest-SnapshotMetadataTestJSON-1575416046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b.d1632bd8-fb45-460d-8955-e864ad2d8dcf 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:16 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:16 devstack sudo[99813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b.d1632bd8-fb45-460d-8955-e864ad2d8dcf 1G Sep 01 08:25:16 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:17 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3a1b21e8-0074-41d1-8802-5c612159d13b tempest-SnapshotMetadataTestJSON-1575416046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b.d1632bd8-fb45-460d-8955-e864ad2d8dcf 1G" returned: 0 in 0.506s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3a1b21e8-0074-41d1-8802-5c612159d13b tempest-SnapshotMetadataTestJSON-1575416046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55f76976-9a61-40f9-ae1f-27cf581d886b -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b.d1632bd8-fb45-460d-8955-e864ad2d8dcf {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:17 devstack sudo[99823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55f76976-9a61-40f9-ae1f-27cf581d886b -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b.d1632bd8-fb45-460d-8955-e864ad2d8dcf Sep 01 08:25:17 devstack sudo[99823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:17 devstack sudo[99823]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3a1b21e8-0074-41d1-8802-5c612159d13b tempest-SnapshotMetadataTestJSON-1575416046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55f76976-9a61-40f9-ae1f-27cf581d886b -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b.d1632bd8-fb45-460d-8955-e864ad2d8dcf" returned: 0 in 0.371s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:17 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-3a1b21e8-0074-41d1-8802-5c612159d13b tempest-SnapshotMetadataTestJSON-1575416046 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b.d1632bd8-fb45-460d-8955-e864ad2d8dcf is being set with open permissions: ugo+rw Sep 01 08:25:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3a1b21e8-0074-41d1-8802-5c612159d13b tempest-SnapshotMetadataTestJSON-1575416046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b.d1632bd8-fb45-460d-8955-e864ad2d8dcf {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:17 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b.d1632bd8-fb45-460d-8955-e864ad2d8dcf Sep 01 08:25:17 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:18 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3a1b21e8-0074-41d1-8802-5c612159d13b tempest-SnapshotMetadataTestJSON-1575416046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b.d1632bd8-fb45-460d-8955-e864ad2d8dcf" returned: 0 in 0.302s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3a1b21e8-0074-41d1-8802-5c612159d13b tempest-SnapshotMetadataTestJSON-1575416046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:18 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b.info Sep 01 08:25:18 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:18 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3a1b21e8-0074-41d1-8802-5c612159d13b tempest-SnapshotMetadataTestJSON-1575416046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b.info" returned: 0 in 0.279s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:18 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-3a1b21e8-0074-41d1-8802-5c612159d13b tempest-SnapshotMetadataTestJSON-1575416046 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b.info is being set with open permissions: ugo+rw Sep 01 08:25:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3a1b21e8-0074-41d1-8802-5c612159d13b tempest-SnapshotMetadataTestJSON-1575416046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:18 devstack sudo[99836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b.info Sep 01 08:25:18 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:18 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3a1b21e8-0074-41d1-8802-5c612159d13b tempest-SnapshotMetadataTestJSON-1575416046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b.info" returned: 0 in 0.256s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3a1b21e8-0074-41d1-8802-5c612159d13b tempest-SnapshotMetadataTestJSON-1575416046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.360s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:18 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-3a1b21e8-0074-41d1-8802-5c612159d13b tempest-SnapshotMetadataTestJSON-1575416046 None] Create snapshot completed successfully Sep 01 08:25:18 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:25:18 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] Flow 'volume_create_manager' (f50fc5cb-4ab6-405f-8c5a-7746726cb92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:25:18 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1448647-ed07-4c43-bb80-5a488ddf8b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:18 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1448647-ed07-4c43-bb80-5a488ddf8b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1904320547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7b13ba3-c2e7-436c-80de-d3573abf1781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc289e2f30054ab38be47aef9c74a7b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:25:19Z,use_quota=True,user_id='2451cf693429479fa1a93b69c3a8b31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:18 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24faf594-c9b6-4abb-8bb3-e77e6b8cf6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:18 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24faf594-c9b6-4abb-8bb3-e77e6b8cf6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:18 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc366fb-1201-4d36-8b41-f1e99075e8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:18 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc366fb-1201-4d36-8b41-f1e99075e8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7b13ba3-c2e7-436c-80de-d3573abf1781', 'volume_name': 'volume-a7b13ba3-c2e7-436c-80de-d3573abf1781', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b715a563-4f56-42e1-92ac-03e562d01364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b715a563-4f56-42e1-92ac-03e562d01364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c49604-c517-4c4d-a3a1-437bb464f2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:19 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] Volume a7b13ba3-c2e7-436c-80de-d3573abf1781: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7b13ba3-c2e7-436c-80de-d3573abf1781', 'volume_size': 1} Sep 01 08:25:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:19 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1904320547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7b13ba3-c2e7-436c-80de-d3573abf1781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc289e2f30054ab38be47aef9c74a7b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:25:19Z,use_quota=True,user_id='2451cf693429479fa1a93b69c3a8b31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:25:19 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] Creating volume a7b13ba3-c2e7-436c-80de-d3573abf1781 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:25:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:19 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:25:19 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:25:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:19 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:25:19 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:25:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a7b13ba3-c2e7-436c-80de-d3573abf1781 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:19 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a7b13ba3-c2e7-436c-80de-d3573abf1781 1073741824 Sep 01 08:25:19 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:19 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a7b13ba3-c2e7-436c-80de-d3573abf1781 1073741824" returned: 0 in 0.472s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a7b13ba3-c2e7-436c-80de-d3573abf1781 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:19 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a7b13ba3-c2e7-436c-80de-d3573abf1781 Sep 01 08:25:19 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:19 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a7b13ba3-c2e7-436c-80de-d3573abf1781" returned: 0 in 0.313s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:19 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:25:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c49604-c517-4c4d-a3a1-437bb464f2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7b13ba3-c2e7-436c-80de-d3573abf1781', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd9e469-3658-4dda-8136-4217aeca1760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:19 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] Volume volume-a7b13ba3-c2e7-436c-80de-d3573abf1781 (a7b13ba3-c2e7-436c-80de-d3573abf1781): created successfully Sep 01 08:25:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd9e469-3658-4dda-8136-4217aeca1760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] Flow 'volume_create_manager' (f50fc5cb-4ab6-405f-8c5a-7746726cb92f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:25:19 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-ad5c891b-0653-4210-83f0-c42565e7390f tempest-VolumesActionsTest-620852510 None] Created volume successfully. Sep 01 08:25:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-09676a24-6092-4a06-b219-4fe2bd89ca81 tempest-SnapshotMetadataTestJSON-1575416046 None] Acquiring lock "cinder-d1632bd8-fb45-460d-8955-e864ad2d8dcf-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-09676a24-6092-4a06-b219-4fe2bd89ca81 tempest-SnapshotMetadataTestJSON-1575416046 None] Lock "cinder-d1632bd8-fb45-460d-8955-e864ad2d8dcf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-09676a24-6092-4a06-b219-4fe2bd89ca81 tempest-SnapshotMetadataTestJSON-1575416046 None] Acquiring lock "cinder-quobyte-55f76976-9a61-40f9-ae1f-27cf581d886b" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-09676a24-6092-4a06-b219-4fe2bd89ca81 tempest-SnapshotMetadataTestJSON-1575416046 None] Lock "cinder-quobyte-55f76976-9a61-40f9-ae1f-27cf581d886b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-09676a24-6092-4a06-b219-4fe2bd89ca81 tempest-SnapshotMetadataTestJSON-1575416046 None] Acquiring lock "cinder-quobyte-d1632bd8-fb45-460d-8955-e864ad2d8dcf" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-09676a24-6092-4a06-b219-4fe2bd89ca81 tempest-SnapshotMetadataTestJSON-1575416046 None] Lock "cinder-quobyte-d1632bd8-fb45-460d-8955-e864ad2d8dcf" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-09676a24-6092-4a06-b219-4fe2bd89ca81 tempest-SnapshotMetadataTestJSON-1575416046 None] Deleting offline snapshot d1632bd8-fb45-460d-8955-e864ad2d8dcf of volume 55f76976-9a61-40f9-ae1f-27cf581d886b {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:25:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-09676a24-6092-4a06-b219-4fe2bd89ca81 tempest-SnapshotMetadataTestJSON-1575416046 None] snapshot_file for this snap is: volume-55f76976-9a61-40f9-ae1f-27cf581d886b.d1632bd8-fb45-460d-8955-e864ad2d8dcf {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:25:20 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10aeecd-cf09-4407-a090-9539c0ce25a0]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:25:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-09676a24-6092-4a06-b219-4fe2bd89ca81 tempest-SnapshotMetadataTestJSON-1575416046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b.d1632bd8-fb45-460d-8955-e864ad2d8dcf {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:20 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b.d1632bd8-fb45-460d-8955-e864ad2d8dcf Sep 01 08:25:20 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:20 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-09676a24-6092-4a06-b219-4fe2bd89ca81 tempest-SnapshotMetadataTestJSON-1575416046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b.d1632bd8-fb45-460d-8955-e864ad2d8dcf" returned: 0 in 0.364s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-09676a24-6092-4a06-b219-4fe2bd89ca81 tempest-SnapshotMetadataTestJSON-1575416046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55f76976-9a61-40f9-ae1f-27cf581d886b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:25:20 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48e68aa-1fc9-4f07-b76a-919f626d8325]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:25:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-09676a24-6092-4a06-b219-4fe2bd89ca81 tempest-SnapshotMetadataTestJSON-1575416046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:20 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b Sep 01 08:25:20 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:21 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b7603916-c8af-4d52-8c84-198811bf2901 tempest-VolumesActionsTest-620852510 None] Acquiring lock "cinder-a7b13ba3-c2e7-436c-80de-d3573abf1781" by "attach_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:21 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b7603916-c8af-4d52-8c84-198811bf2901 tempest-VolumesActionsTest-620852510 None] Lock "cinder-a7b13ba3-c2e7-436c-80de-d3573abf1781" acquired by "attach_volume" :: waited 0.026s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:21 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-09676a24-6092-4a06-b219-4fe2bd89ca81 tempest-SnapshotMetadataTestJSON-1575416046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b" returned: 0 in 0.381s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-09676a24-6092-4a06-b219-4fe2bd89ca81 tempest-SnapshotMetadataTestJSON-1575416046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b.d1632bd8-fb45-460d-8955-e864ad2d8dcf {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:21 devstack sudo[99859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b.d1632bd8-fb45-460d-8955-e864ad2d8dcf Sep 01 08:25:21 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:21 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-b7603916-c8af-4d52-8c84-198811bf2901 tempest-VolumesActionsTest-620852510 None] Attaching volume a7b13ba3-c2e7-436c-80de-d3573abf1781 to instance b440d8ed-0910-4306-a1ae-9f86b3c3716e at mountpoint /dev/vdb on host None. Sep 01 08:25:21 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-b7603916-c8af-4d52-8c84-198811bf2901 tempest-VolumesActionsTest-620852510 None] Attach volume completed successfully. Sep 01 08:25:21 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b7603916-c8af-4d52-8c84-198811bf2901 tempest-VolumesActionsTest-620852510 None] Lock "cinder-a7b13ba3-c2e7-436c-80de-d3573abf1781" released by "attach_volume" :: held 0.135s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:21 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-09676a24-6092-4a06-b219-4fe2bd89ca81 tempest-SnapshotMetadataTestJSON-1575416046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b.d1632bd8-fb45-460d-8955-e864ad2d8dcf" returned: 0 in 0.372s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-09676a24-6092-4a06-b219-4fe2bd89ca81 tempest-SnapshotMetadataTestJSON-1575416046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b.d1632bd8-fb45-460d-8955-e864ad2d8dcf {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:21 devstack sudo[99864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b.d1632bd8-fb45-460d-8955-e864ad2d8dcf Sep 01 08:25:21 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:21 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-09676a24-6092-4a06-b219-4fe2bd89ca81 tempest-SnapshotMetadataTestJSON-1575416046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b.d1632bd8-fb45-460d-8955-e864ad2d8dcf" returned: 0 in 0.258s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:21 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-4c5cedc9-3b1e-469a-9216-db112db52984 tempest-VolumesActionsTest-1900412411 None] Terminate volume connection completed successfully. Sep 01 08:25:21 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-09676a24-6092-4a06-b219-4fe2bd89ca81 tempest-SnapshotMetadataTestJSON-1575416046 None] Lock "cinder-quobyte-d1632bd8-fb45-460d-8955-e864ad2d8dcf" released by "_delete_snapshot" :: held 1.499s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:21 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-09676a24-6092-4a06-b219-4fe2bd89ca81 tempest-SnapshotMetadataTestJSON-1575416046 None] Lock "cinder-quobyte-55f76976-9a61-40f9-ae1f-27cf581d886b" released by "delete_snapshot" :: held 1.522s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:21 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4c5cedc9-3b1e-469a-9216-db112db52984 tempest-VolumesActionsTest-1900412411 None] Acquiring lock "cinder-a7b13ba3-c2e7-436c-80de-d3573abf1781-detach_volume" by "detach_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:21 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4c5cedc9-3b1e-469a-9216-db112db52984 tempest-VolumesActionsTest-1900412411 None] Lock "cinder-a7b13ba3-c2e7-436c-80de-d3573abf1781-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:21 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-4c5cedc9-3b1e-469a-9216-db112db52984 tempest-VolumesActionsTest-1900412411 None] Detaching volume a7b13ba3-c2e7-436c-80de-d3573abf1781 from instance b440d8ed-0910-4306-a1ae-9f86b3c3716e. Sep 01 08:25:21 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-09676a24-6092-4a06-b219-4fe2bd89ca81 tempest-SnapshotMetadataTestJSON-1575416046 None] Created reservations ['8fc37cbc-7c11-4a1c-a6e3-8758a03ff4f2', 'e96788cd-6abf-4e44-bdec-d2ea5d3e4a32', '3e3948d2-88df-426f-a6da-ff2e37419648', '723b2180-22e7-443d-9c3e-51f1eb3b5415'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:25:21 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-4c5cedc9-3b1e-469a-9216-db112db52984 tempest-VolumesActionsTest-1900412411 None] Detach volume completed successfully. Sep 01 08:25:21 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4c5cedc9-3b1e-469a-9216-db112db52984 tempest-VolumesActionsTest-1900412411 None] Lock "cinder-a7b13ba3-c2e7-436c-80de-d3573abf1781-detach_volume" released by "detach_volume" :: held 0.111s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:21 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-09676a24-6092-4a06-b219-4fe2bd89ca81 tempest-SnapshotMetadataTestJSON-1575416046 None] Delete snapshot completed successfully. Sep 01 08:25:22 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-09676a24-6092-4a06-b219-4fe2bd89ca81 tempest-SnapshotMetadataTestJSON-1575416046 None] Lock "cinder-d1632bd8-fb45-460d-8955-e864ad2d8dcf-delete_snapshot" released by "delete_snapshot" :: held 1.739s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:22 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-cffa69c8-6030-429c-b122-e3054526762f tempest-VolumesActionsTest-620852510 None] Acquiring lock "cinder-a7b13ba3-c2e7-436c-80de-d3573abf1781-detach_volume" by "detach_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:22 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-cffa69c8-6030-429c-b122-e3054526762f tempest-VolumesActionsTest-620852510 None] Lock "cinder-a7b13ba3-c2e7-436c-80de-d3573abf1781-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:22 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-cffa69c8-6030-429c-b122-e3054526762f tempest-VolumesActionsTest-620852510 None] Volume detach called, but volume not attached. Sep 01 08:25:22 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-cffa69c8-6030-429c-b122-e3054526762f tempest-VolumesActionsTest-620852510 None] Lock "cinder-a7b13ba3-c2e7-436c-80de-d3573abf1781-detach_volume" released by "detach_volume" :: held 0.021s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:22 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bd2c89ca-3b06-448f-836d-ce1ac14d10c2 tempest-VolumesActionsTest-620852510 None] Acquiring lock "cinder-a7b13ba3-c2e7-436c-80de-d3573abf1781-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:22 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bd2c89ca-3b06-448f-836d-ce1ac14d10c2 tempest-VolumesActionsTest-620852510 None] Lock "cinder-a7b13ba3-c2e7-436c-80de-d3573abf1781-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:22 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bd2c89ca-3b06-448f-836d-ce1ac14d10c2 tempest-VolumesActionsTest-620852510 None] Acquiring lock "cinder-quobyte-a7b13ba3-c2e7-436c-80de-d3573abf1781" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:22 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bd2c89ca-3b06-448f-836d-ce1ac14d10c2 tempest-VolumesActionsTest-620852510 None] Lock "cinder-quobyte-a7b13ba3-c2e7-436c-80de-d3573abf1781" acquired by "delete_volume" :: waited 0.036s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:22 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a530d0-2006-4ae9-887f-e4dda1badfa6]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:25:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bd2c89ca-3b06-448f-836d-ce1ac14d10c2 tempest-VolumesActionsTest-620852510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a7b13ba3-c2e7-436c-80de-d3573abf1781 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:22 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1eac5e72-0de6-4f53-9675-2c198ab6a437 tempest-SnapshotMetadataTestJSON-1575416046 None] Acquiring lock "cinder-55f76976-9a61-40f9-ae1f-27cf581d886b-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:22 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1eac5e72-0de6-4f53-9675-2c198ab6a437 tempest-SnapshotMetadataTestJSON-1575416046 None] Lock "cinder-55f76976-9a61-40f9-ae1f-27cf581d886b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:22 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1eac5e72-0de6-4f53-9675-2c198ab6a437 tempest-SnapshotMetadataTestJSON-1575416046 None] Acquiring lock "cinder-quobyte-55f76976-9a61-40f9-ae1f-27cf581d886b" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:22 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1eac5e72-0de6-4f53-9675-2c198ab6a437 tempest-SnapshotMetadataTestJSON-1575416046 None] Lock "cinder-quobyte-55f76976-9a61-40f9-ae1f-27cf581d886b" acquired by "delete_volume" :: waited 0.022s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:22 devstack sudo[99869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a7b13ba3-c2e7-436c-80de-d3573abf1781 Sep 01 08:25:22 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:22 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[4463a772-ae7d-452f-9c82-03974dd36ab1]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:25:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1eac5e72-0de6-4f53-9675-2c198ab6a437 tempest-SnapshotMetadataTestJSON-1575416046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:22 devstack sudo[99871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b Sep 01 08:25:22 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:22 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bd2c89ca-3b06-448f-836d-ce1ac14d10c2 tempest-VolumesActionsTest-620852510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a7b13ba3-c2e7-436c-80de-d3573abf1781" returned: 0 in 0.433s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bd2c89ca-3b06-448f-836d-ce1ac14d10c2 tempest-VolumesActionsTest-620852510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a7b13ba3-c2e7-436c-80de-d3573abf1781 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:23 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a7b13ba3-c2e7-436c-80de-d3573abf1781 Sep 01 08:25:23 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:23 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1eac5e72-0de6-4f53-9675-2c198ab6a437 tempest-SnapshotMetadataTestJSON-1575416046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b" returned: 0 in 0.413s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1eac5e72-0de6-4f53-9675-2c198ab6a437 tempest-SnapshotMetadataTestJSON-1575416046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:23 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b Sep 01 08:25:23 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:23 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bd2c89ca-3b06-448f-836d-ce1ac14d10c2 tempest-VolumesActionsTest-620852510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a7b13ba3-c2e7-436c-80de-d3573abf1781" returned: 0 in 0.254s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:23 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bd2c89ca-3b06-448f-836d-ce1ac14d10c2 tempest-VolumesActionsTest-620852510 None] Lock "cinder-quobyte-a7b13ba3-c2e7-436c-80de-d3573abf1781" released by "delete_volume" :: held 0.749s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:23 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-bd2c89ca-3b06-448f-836d-ce1ac14d10c2 tempest-VolumesActionsTest-620852510 None] Created reservations ['6b4fd935-3430-40b4-8c82-a0e0ed963572', '0c7ea2ee-ca09-451c-9577-65498a54fecc', 'c4cc55a3-d286-44ed-8e68-264315c22df2', 'b268bda4-f7eb-4b3b-b73d-167aa6601ffa'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:25:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bd2c89ca-3b06-448f-836d-ce1ac14d10c2 tempest-VolumesActionsTest-620852510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bd2c89ca-3b06-448f-836d-ce1ac14d10c2 tempest-VolumesActionsTest-620852510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:23 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bd2c89ca-3b06-448f-836d-ce1ac14d10c2 tempest-VolumesActionsTest-620852510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:25:23 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:23 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bd2c89ca-3b06-448f-836d-ce1ac14d10c2 tempest-VolumesActionsTest-620852510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:25:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bd2c89ca-3b06-448f-836d-ce1ac14d10c2 tempest-VolumesActionsTest-620852510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bd2c89ca-3b06-448f-836d-ce1ac14d10c2 tempest-VolumesActionsTest-620852510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1eac5e72-0de6-4f53-9675-2c198ab6a437 tempest-SnapshotMetadataTestJSON-1575416046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-55f76976-9a61-40f9-ae1f-27cf581d886b" returned: 0 in 0.285s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:23 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:25:23 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1eac5e72-0de6-4f53-9675-2c198ab6a437 tempest-SnapshotMetadataTestJSON-1575416046 None] Lock "cinder-quobyte-55f76976-9a61-40f9-ae1f-27cf581d886b" released by "delete_volume" :: held 0.766s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:23 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:23 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-1eac5e72-0de6-4f53-9675-2c198ab6a437 tempest-SnapshotMetadataTestJSON-1575416046 None] Created reservations ['60b3ced3-c208-406d-8802-a2ea9d67f5d8', 'e16be249-09f6-462f-86ee-c3426bdb5d22', '6e772552-fc14-4e0b-b63b-839c579076d9', '356630d2-e9fe-454d-9069-cc17f7d39fd8'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:25:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1eac5e72-0de6-4f53-9675-2c198ab6a437 tempest-SnapshotMetadataTestJSON-1575416046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1eac5e72-0de6-4f53-9675-2c198ab6a437 tempest-SnapshotMetadataTestJSON-1575416046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:23 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1eac5e72-0de6-4f53-9675-2c198ab6a437 tempest-SnapshotMetadataTestJSON-1575416046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:25:23 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1eac5e72-0de6-4f53-9675-2c198ab6a437 tempest-SnapshotMetadataTestJSON-1575416046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:25:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1eac5e72-0de6-4f53-9675-2c198ab6a437 tempest-SnapshotMetadataTestJSON-1575416046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1eac5e72-0de6-4f53-9675-2c198ab6a437 tempest-SnapshotMetadataTestJSON-1575416046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:23 devstack sudo[99889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:25:23 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:23 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bd2c89ca-3b06-448f-836d-ce1ac14d10c2 tempest-VolumesActionsTest-620852510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.348s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:23 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-bd2c89ca-3b06-448f-836d-ce1ac14d10c2 tempest-VolumesActionsTest-620852510 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:25:23 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-bd2c89ca-3b06-448f-836d-ce1ac14d10c2 tempest-VolumesActionsTest-620852510 None] Deleted volume successfully. Sep 01 08:25:23 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bd2c89ca-3b06-448f-836d-ce1ac14d10c2 tempest-VolumesActionsTest-620852510 None] Lock "cinder-a7b13ba3-c2e7-436c-80de-d3573abf1781-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:23 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1eac5e72-0de6-4f53-9675-2c198ab6a437 tempest-SnapshotMetadataTestJSON-1575416046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.353s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:23 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-1eac5e72-0de6-4f53-9675-2c198ab6a437 tempest-SnapshotMetadataTestJSON-1575416046 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:25:24 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-1eac5e72-0de6-4f53-9675-2c198ab6a437 tempest-SnapshotMetadataTestJSON-1575416046 None] Deleted volume successfully. Sep 01 08:25:24 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1eac5e72-0de6-4f53-9675-2c198ab6a437 tempest-SnapshotMetadataTestJSON-1575416046 None] Lock "cinder-55f76976-9a61-40f9-ae1f-27cf581d886b-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] Flow 'volume_create_manager' (f3eb80c4-b305-45c0-b077-0f98abdba877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (641b4273-a898-4f45-b7f2-420bfd224e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (641b4273-a898-4f45-b7f2-420bfd224e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1360258239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c11a6efb-5d27-4d01-be5e-84799d5fa690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc289e2f30054ab38be47aef9c74a7b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:25:27Z,use_quota=True,user_id='2451cf693429479fa1a93b69c3a8b31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd7e819b-dcc7-48f9-913f-a620bd7f7b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd7e819b-dcc7-48f9-913f-a620bd7f7b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ea47b4-48fd-4347-8d67-f78acf6c6491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ea47b4-48fd-4347-8d67-f78acf6c6491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c11a6efb-5d27-4d01-be5e-84799d5fa690', 'volume_name': 'volume-c11a6efb-5d27-4d01-be5e-84799d5fa690', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d33bea-5b87-43eb-99e5-70a859242c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d33bea-5b87-43eb-99e5-70a859242c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad96ed6-8e82-4c1d-988b-e76166117050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:27 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] Volume c11a6efb-5d27-4d01-be5e-84799d5fa690: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c11a6efb-5d27-4d01-be5e-84799d5fa690', 'volume_size': 1} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1360258239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c11a6efb-5d27-4d01-be5e-84799d5fa690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc289e2f30054ab38be47aef9c74a7b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:25:27Z,use_quota=True,user_id='2451cf693429479fa1a93b69c3a8b31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] Creating volume c11a6efb-5d27-4d01-be5e-84799d5fa690 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:25:27 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c11a6efb-5d27-4d01-be5e-84799d5fa690 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:27 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c11a6efb-5d27-4d01-be5e-84799d5fa690 1073741824 Sep 01 08:25:27 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] Flow 'volume_create_manager' (fd192a4d-19db-4323-a9a2-666fc0797500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f027f1c-a446-46ae-a0c8-b1553d7c1c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f027f1c-a446-46ae-a0c8-b1553d7c1c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-469277438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06a9fd79-0c15-4dc3-8de7-eb9c56e12773,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f298370bb9140368ac2d59e081be57f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:25:27Z,use_quota=True,user_id='2b3126a6bf2e4fd09e768e7ce9f1264e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c6fdcb-b5e0-4eba-8937-5661eaad24f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c6fdcb-b5e0-4eba-8937-5661eaad24f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc9488fc-b0a1-4eaa-8bea-585492d35d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc9488fc-b0a1-4eaa-8bea-585492d35d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06a9fd79-0c15-4dc3-8de7-eb9c56e12773', 'volume_name': 'volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f278155b-e96e-44e9-81ba-c13137e96ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f278155b-e96e-44e9-81ba-c13137e96ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e68c880-b4e1-4a6e-873f-8ee3d515342c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:27 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] Volume 06a9fd79-0c15-4dc3-8de7-eb9c56e12773: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773', 'volume_size': 1} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:27 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c11a6efb-5d27-4d01-be5e-84799d5fa690 1073741824" returned: 0 in 0.394s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c11a6efb-5d27-4d01-be5e-84799d5fa690 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:27 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c11a6efb-5d27-4d01-be5e-84799d5fa690 Sep 01 08:25:27 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:27 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c11a6efb-5d27-4d01-be5e-84799d5fa690" returned: 0 in 0.241s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.560s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-469277438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06a9fd79-0c15-4dc3-8de7-eb9c56e12773,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f298370bb9140368ac2d59e081be57f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:25:27Z,use_quota=True,user_id='2b3126a6bf2e4fd09e768e7ce9f1264e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] Creating volume 06a9fd79-0c15-4dc3-8de7-eb9c56e12773 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:25:27 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad96ed6-8e82-4c1d-988b-e76166117050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c11a6efb-5d27-4d01-be5e-84799d5fa690', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:27 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773 1073741824 Sep 01 08:25:27 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01c18d70-c909-484f-9545-7e8d76804fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:27 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] Volume volume-c11a6efb-5d27-4d01-be5e-84799d5fa690 (c11a6efb-5d27-4d01-be5e-84799d5fa690): created successfully Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01c18d70-c909-484f-9545-7e8d76804fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] Flow 'volume_create_manager' (f3eb80c4-b305-45c0-b077-0f98abdba877) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:25:27 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-e4d4bbc0-6633-4f52-8705-37cbcdd1fae8 tempest-VolumesActionsTest-620852510 None] Created volume successfully. Sep 01 08:25:28 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773 1073741824" returned: 0 in 0.408s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:28 devstack sudo[99934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773 Sep 01 08:25:28 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:28 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773" returned: 0 in 0.242s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:25:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e68c880-b4e1-4a6e-873f-8ee3d515342c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91608bef-3594-44ab-832b-5affa30c32ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:28 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] Volume volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773 (06a9fd79-0c15-4dc3-8de7-eb9c56e12773): created successfully Sep 01 08:25:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91608bef-3594-44ab-832b-5affa30c32ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] Flow 'volume_create_manager' (fd192a4d-19db-4323-a9a2-666fc0797500) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:25:28 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-466982e9-18d7-4d76-ac87-0d0075315ff6 tempest-VolumesDeleteCascade-766405974 None] Created volume successfully. Sep 01 08:25:29 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4a62cf32-6c82-49ae-8415-21c6d93c64b7 tempest-VolumesActionsTest-1900412411 None] Acquiring lock "cinder-c11a6efb-5d27-4d01-be5e-84799d5fa690-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:29 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4a62cf32-6c82-49ae-8415-21c6d93c64b7 tempest-VolumesActionsTest-1900412411 None] Lock "cinder-c11a6efb-5d27-4d01-be5e-84799d5fa690-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:29 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4a62cf32-6c82-49ae-8415-21c6d93c64b7 tempest-VolumesActionsTest-1900412411 None] Acquiring lock "cinder-quobyte-c11a6efb-5d27-4d01-be5e-84799d5fa690" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:29 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4a62cf32-6c82-49ae-8415-21c6d93c64b7 tempest-VolumesActionsTest-1900412411 None] Lock "cinder-quobyte-c11a6efb-5d27-4d01-be5e-84799d5fa690" acquired by "delete_volume" :: waited 0.019s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c960feb0-035f-4d3e-a832-eb1f83557ff6 tempest-VolumesDeleteCascade-766405974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c960feb0-035f-4d3e-a832-eb1f83557ff6 tempest-VolumesDeleteCascade-766405974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-c960feb0-035f-4d3e-a832-eb1f83557ff6 tempest-VolumesDeleteCascade-766405974 None] Creating offline snapshot e398f410-f4ab-4ba7-bec1-3c12b4593140 of volume 06a9fd79-0c15-4dc3-8de7-eb9c56e12773 {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:25:29 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23ef1cc-5e57-4ca0-b528-be63d815c9ad]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:25:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4a62cf32-6c82-49ae-8415-21c6d93c64b7 tempest-VolumesActionsTest-1900412411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c11a6efb-5d27-4d01-be5e-84799d5fa690 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:29 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[33027fae-85a9-4e9f-ac9e-5e505d1bea32]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:25:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c960feb0-035f-4d3e-a832-eb1f83557ff6 tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:29 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c11a6efb-5d27-4d01-be5e-84799d5fa690 Sep 01 08:25:29 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:29 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773 Sep 01 08:25:29 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:29 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4a62cf32-6c82-49ae-8415-21c6d93c64b7 tempest-VolumesActionsTest-1900412411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c11a6efb-5d27-4d01-be5e-84799d5fa690" returned: 0 in 0.364s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4a62cf32-6c82-49ae-8415-21c6d93c64b7 tempest-VolumesActionsTest-1900412411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c11a6efb-5d27-4d01-be5e-84799d5fa690 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:29 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c960feb0-035f-4d3e-a832-eb1f83557ff6 tempest-VolumesDeleteCascade-766405974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773" returned: 0 in 0.364s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c960feb0-035f-4d3e-a832-eb1f83557ff6 tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:29 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c11a6efb-5d27-4d01-be5e-84799d5fa690 Sep 01 08:25:29 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:29 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140 1G Sep 01 08:25:29 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:29 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4a62cf32-6c82-49ae-8415-21c6d93c64b7 tempest-VolumesActionsTest-1900412411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c11a6efb-5d27-4d01-be5e-84799d5fa690" returned: 0 in 0.245s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:29 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4a62cf32-6c82-49ae-8415-21c6d93c64b7 tempest-VolumesActionsTest-1900412411 None] Lock "cinder-quobyte-c11a6efb-5d27-4d01-be5e-84799d5fa690" released by "delete_volume" :: held 0.660s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:30 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-4a62cf32-6c82-49ae-8415-21c6d93c64b7 tempest-VolumesActionsTest-1900412411 None] Created reservations ['1add8289-9004-4824-8f2b-8f5459acaf11', '1699f0c1-b10d-4bcd-ab1a-d68479da3c37', '6ab19ecb-6eab-4e6b-b2f7-4d3ff1a0e8b9', '5e829dac-ae2c-450b-a70d-80c48efa51ad'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:25:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4a62cf32-6c82-49ae-8415-21c6d93c64b7 tempest-VolumesActionsTest-1900412411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4a62cf32-6c82-49ae-8415-21c6d93c64b7 tempest-VolumesActionsTest-1900412411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4a62cf32-6c82-49ae-8415-21c6d93c64b7 tempest-VolumesActionsTest-1900412411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:25:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4a62cf32-6c82-49ae-8415-21c6d93c64b7 tempest-VolumesActionsTest-1900412411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:25:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4a62cf32-6c82-49ae-8415-21c6d93c64b7 tempest-VolumesActionsTest-1900412411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4a62cf32-6c82-49ae-8415-21c6d93c64b7 tempest-VolumesActionsTest-1900412411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:30 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:25:30 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:30 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c960feb0-035f-4d3e-a832-eb1f83557ff6 tempest-VolumesDeleteCascade-766405974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140 1G" returned: 0 in 0.428s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c960feb0-035f-4d3e-a832-eb1f83557ff6 tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:30 devstack sudo[99959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140 Sep 01 08:25:30 devstack sudo[99959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:30 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4a62cf32-6c82-49ae-8415-21c6d93c64b7 tempest-VolumesActionsTest-1900412411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.256s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:30 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-4a62cf32-6c82-49ae-8415-21c6d93c64b7 tempest-VolumesActionsTest-1900412411 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:25:30 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-4a62cf32-6c82-49ae-8415-21c6d93c64b7 tempest-VolumesActionsTest-1900412411 None] Deleted volume successfully. Sep 01 08:25:30 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4a62cf32-6c82-49ae-8415-21c6d93c64b7 tempest-VolumesActionsTest-1900412411 None] Lock "cinder-c11a6efb-5d27-4d01-be5e-84799d5fa690-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:30 devstack sudo[99959]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c960feb0-035f-4d3e-a832-eb1f83557ff6 tempest-VolumesDeleteCascade-766405974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140" returned: 0 in 0.333s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:30 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-c960feb0-035f-4d3e-a832-eb1f83557ff6 tempest-VolumesDeleteCascade-766405974 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140 is being set with open permissions: ugo+rw Sep 01 08:25:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c960feb0-035f-4d3e-a832-eb1f83557ff6 tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:30 devstack sudo[99966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140 Sep 01 08:25:30 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:30 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c960feb0-035f-4d3e-a832-eb1f83557ff6 tempest-VolumesDeleteCascade-766405974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140" returned: 0 in 0.252s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c960feb0-035f-4d3e-a832-eb1f83557ff6 tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:30 devstack sudo[99969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.info Sep 01 08:25:30 devstack sudo[99969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:30 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:25:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] Flow 'volume_create_manager' (75c6cfee-b7be-4eff-8638-ee1f65fbcbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:25:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f924ecf-aa58-4d38-a161-ba4929901a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f924ecf-aa58-4d38-a161-ba4929901a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1666407523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b91174-2172-4826-8795-fd751b0b89d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc289e2f30054ab38be47aef9c74a7b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:25:31Z,use_quota=True,user_id='2451cf693429479fa1a93b69c3a8b31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc046ce-ff85-4f35-9b16-0c93fbc12a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc046ce-ff85-4f35-9b16-0c93fbc12a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a37802d-f50b-495b-9f95-1f6fa4d40429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a37802d-f50b-495b-9f95-1f6fa4d40429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58b91174-2172-4826-8795-fd751b0b89d5', 'volume_name': 'volume-58b91174-2172-4826-8795-fd751b0b89d5', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (343bb2ae-764f-4778-ba69-e09cff3ef8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (343bb2ae-764f-4778-ba69-e09cff3ef8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cac957c7-216b-4ec0-b72d-74931b183e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:30 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] Volume 58b91174-2172-4826-8795-fd751b0b89d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58b91174-2172-4826-8795-fd751b0b89d5', 'volume_size': 1} Sep 01 08:25:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:31 devstack sudo[99969]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c960feb0-035f-4d3e-a832-eb1f83557ff6 tempest-VolumesDeleteCascade-766405974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.info" returned: 0 in 0.246s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:31 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-c960feb0-035f-4d3e-a832-eb1f83557ff6 tempest-VolumesDeleteCascade-766405974 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.info is being set with open permissions: ugo+rw Sep 01 08:25:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c960feb0-035f-4d3e-a832-eb1f83557ff6 tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:31 devstack sudo[99972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.info Sep 01 08:25:31 devstack sudo[99972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:25:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:25:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:25:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:31 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:25:31 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:31 devstack sudo[99972]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c960feb0-035f-4d3e-a832-eb1f83557ff6 tempest-VolumesDeleteCascade-766405974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.info" returned: 0 in 0.242s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c960feb0-035f-4d3e-a832-eb1f83557ff6 tempest-VolumesDeleteCascade-766405974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.952s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.301s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1666407523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b91174-2172-4826-8795-fd751b0b89d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc289e2f30054ab38be47aef9c74a7b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:25:31Z,use_quota=True,user_id='2451cf693429479fa1a93b69c3a8b31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:25:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] Creating volume 58b91174-2172-4826-8795-fd751b0b89d5 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:25:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:25:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:25:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:25:31 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:25:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-58b91174-2172-4826-8795-fd751b0b89d5 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:31 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.249s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:31 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:25:31 devstack sudo[99978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-58b91174-2172-4826-8795-fd751b0b89d5 1073741824 Sep 01 08:25:31 devstack sudo[99978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager._thread_info {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:25:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread count: 28 {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 08:25:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread info: [<_MainThread(MainThread, started 138934582050944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 08:25:31 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-c960feb0-035f-4d3e-a832-eb1f83557ff6 tempest-VolumesDeleteCascade-766405974 None] Create snapshot completed successfully Sep 01 08:25:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5c3641ab-0604-4442-9e26-7885f996315b tempest-VolumesDeleteCascade-766405974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:31 devstack sudo[99978]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-58b91174-2172-4826-8795-fd751b0b89d5 1073741824" returned: 0 in 0.437s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-58b91174-2172-4826-8795-fd751b0b89d5 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:31 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-58b91174-2172-4826-8795-fd751b0b89d5 Sep 01 08:25:31 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:32 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-58b91174-2172-4826-8795-fd751b0b89d5" returned: 0 in 0.241s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:32 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:25:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5c3641ab-0604-4442-9e26-7885f996315b tempest-VolumesDeleteCascade-766405974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.430s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cac957c7-216b-4ec0-b72d-74931b183e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58b91174-2172-4826-8795-fd751b0b89d5', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e42283-74de-412d-8396-05bad176da2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:32 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-5c3641ab-0604-4442-9e26-7885f996315b tempest-VolumesDeleteCascade-766405974 None] Creating offline snapshot 69ae61e6-3eee-4c72-b6d9-75e27101efe5 of volume 06a9fd79-0c15-4dc3-8de7-eb9c56e12773 {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:25:32 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17b9f1e-1922-4fd6-9f83-359e4e83c070]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:25:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5c3641ab-0604-4442-9e26-7885f996315b tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:32 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] Volume volume-58b91174-2172-4826-8795-fd751b0b89d5 (58b91174-2172-4826-8795-fd751b0b89d5): created successfully Sep 01 08:25:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e42283-74de-412d-8396-05bad176da2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] Flow 'volume_create_manager' (75c6cfee-b7be-4eff-8638-ee1f65fbcbe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:25:32 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-c1435872-5d6e-4ba0-a96c-cd114657b962 tempest-VolumesActionsTest-620852510 None] Created volume successfully. Sep 01 08:25:32 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140 Sep 01 08:25:32 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:32 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5c3641ab-0604-4442-9e26-7885f996315b tempest-VolumesDeleteCascade-766405974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140" returned: 0 in 0.354s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:32 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-5c3641ab-0604-4442-9e26-7885f996315b tempest-VolumesDeleteCascade-766405974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:25:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5c3641ab-0604-4442-9e26-7885f996315b tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.69ae61e6-3eee-4c72-b6d9-75e27101efe5 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:32 devstack sudo[99991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.69ae61e6-3eee-4c72-b6d9-75e27101efe5 1G Sep 01 08:25:32 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:32 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5c3641ab-0604-4442-9e26-7885f996315b tempest-VolumesDeleteCascade-766405974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.69ae61e6-3eee-4c72-b6d9-75e27101efe5 1G" returned: 0 in 0.390s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5c3641ab-0604-4442-9e26-7885f996315b tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.69ae61e6-3eee-4c72-b6d9-75e27101efe5 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:32 devstack sudo[99996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.69ae61e6-3eee-4c72-b6d9-75e27101efe5 Sep 01 08:25:32 devstack sudo[99996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-cada5b10-70fb-4edf-a9e8-0ee4f7b0fd35 tempest-VolumesActionsTest-1900412411 None] Acquiring lock "cinder-58b91174-2172-4826-8795-fd751b0b89d5-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-cada5b10-70fb-4edf-a9e8-0ee4f7b0fd35 tempest-VolumesActionsTest-1900412411 None] Lock "cinder-58b91174-2172-4826-8795-fd751b0b89d5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:33 devstack sudo[99996]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5c3641ab-0604-4442-9e26-7885f996315b tempest-VolumesDeleteCascade-766405974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.69ae61e6-3eee-4c72-b6d9-75e27101efe5" returned: 0 in 0.313s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:33 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-5c3641ab-0604-4442-9e26-7885f996315b tempest-VolumesDeleteCascade-766405974 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.69ae61e6-3eee-4c72-b6d9-75e27101efe5 is being set with open permissions: ugo+rw Sep 01 08:25:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5c3641ab-0604-4442-9e26-7885f996315b tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.69ae61e6-3eee-4c72-b6d9-75e27101efe5 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:33 devstack sudo[100005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.69ae61e6-3eee-4c72-b6d9-75e27101efe5 Sep 01 08:25:33 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-cada5b10-70fb-4edf-a9e8-0ee4f7b0fd35 tempest-VolumesActionsTest-1900412411 None] Acquiring lock "cinder-quobyte-58b91174-2172-4826-8795-fd751b0b89d5" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-cada5b10-70fb-4edf-a9e8-0ee4f7b0fd35 tempest-VolumesActionsTest-1900412411 None] Lock "cinder-quobyte-58b91174-2172-4826-8795-fd751b0b89d5" acquired by "delete_volume" :: waited 0.017s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:33 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[72862c39-b6b6-4723-a773-a5f21809be2d]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:25:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cada5b10-70fb-4edf-a9e8-0ee4f7b0fd35 tempest-VolumesActionsTest-1900412411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-58b91174-2172-4826-8795-fd751b0b89d5 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:33 devstack sudo[100007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-58b91174-2172-4826-8795-fd751b0b89d5 Sep 01 08:25:33 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:33 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5c3641ab-0604-4442-9e26-7885f996315b tempest-VolumesDeleteCascade-766405974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.69ae61e6-3eee-4c72-b6d9-75e27101efe5" returned: 0 in 0.260s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5c3641ab-0604-4442-9e26-7885f996315b tempest-VolumesDeleteCascade-766405974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.419s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:33 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-5c3641ab-0604-4442-9e26-7885f996315b tempest-VolumesDeleteCascade-766405974 None] Create snapshot completed successfully Sep 01 08:25:33 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cada5b10-70fb-4edf-a9e8-0ee4f7b0fd35 tempest-VolumesActionsTest-1900412411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-58b91174-2172-4826-8795-fd751b0b89d5" returned: 0 in 0.359s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cada5b10-70fb-4edf-a9e8-0ee4f7b0fd35 tempest-VolumesActionsTest-1900412411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-58b91174-2172-4826-8795-fd751b0b89d5 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:33 devstack sudo[100013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-58b91174-2172-4826-8795-fd751b0b89d5 Sep 01 08:25:33 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Acquiring lock "cinder-06a9fd79-0c15-4dc3-8de7-eb9c56e12773-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-06a9fd79-0c15-4dc3-8de7-eb9c56e12773-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Performing cascade delete. {{(pid=86893) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 01 08:25:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Acquiring lock "cinder-69ae61e6-3eee-4c72-b6d9-75e27101efe5-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-69ae61e6-3eee-4c72-b6d9-75e27101efe5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Acquiring lock "cinder-quobyte-06a9fd79-0c15-4dc3-8de7-eb9c56e12773" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:33 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cada5b10-70fb-4edf-a9e8-0ee4f7b0fd35 tempest-VolumesActionsTest-1900412411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-58b91174-2172-4826-8795-fd751b0b89d5" returned: 0 in 0.260s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-cada5b10-70fb-4edf-a9e8-0ee4f7b0fd35 tempest-VolumesActionsTest-1900412411 None] Lock "cinder-quobyte-58b91174-2172-4826-8795-fd751b0b89d5" released by "delete_volume" :: held 0.664s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-quobyte-06a9fd79-0c15-4dc3-8de7-eb9c56e12773" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Acquiring lock "cinder-quobyte-69ae61e6-3eee-4c72-b6d9-75e27101efe5" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-quobyte-69ae61e6-3eee-4c72-b6d9-75e27101efe5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Deleting offline snapshot 69ae61e6-3eee-4c72-b6d9-75e27101efe5 of volume 06a9fd79-0c15-4dc3-8de7-eb9c56e12773 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:25:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] snapshot_file for this snap is: volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.69ae61e6-3eee-4c72-b6d9-75e27101efe5 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:25:33 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[094efb3d-48aa-4b73-b73e-9d75fc8af2d4]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:25:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.69ae61e6-3eee-4c72-b6d9-75e27101efe5 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:33 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-cada5b10-70fb-4edf-a9e8-0ee4f7b0fd35 tempest-VolumesActionsTest-1900412411 None] Created reservations ['587d600c-d6af-4ae5-ba27-34f5e47ac693', 'ff4948e1-8294-4644-905d-0b547678d4ce', 'bc7ede8c-043d-41ed-86a8-684ae313f01e', '70310b74-16b7-4267-8ef3-044bcf701af1'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-cada5b10-70fb-4edf-a9e8-0ee4f7b0fd35 tempest-VolumesActionsTest-1900412411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-cada5b10-70fb-4edf-a9e8-0ee4f7b0fd35 tempest-VolumesActionsTest-1900412411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-cada5b10-70fb-4edf-a9e8-0ee4f7b0fd35 tempest-VolumesActionsTest-1900412411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-cada5b10-70fb-4edf-a9e8-0ee4f7b0fd35 tempest-VolumesActionsTest-1900412411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-cada5b10-70fb-4edf-a9e8-0ee4f7b0fd35 tempest-VolumesActionsTest-1900412411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cada5b10-70fb-4edf-a9e8-0ee4f7b0fd35 tempest-VolumesActionsTest-1900412411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:34 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.69ae61e6-3eee-4c72-b6d9-75e27101efe5 Sep 01 08:25:34 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:34 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:25:34 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:34 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cada5b10-70fb-4edf-a9e8-0ee4f7b0fd35 tempest-VolumesActionsTest-1900412411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.266s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-cada5b10-70fb-4edf-a9e8-0ee4f7b0fd35 tempest-VolumesActionsTest-1900412411 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:25:34 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-cada5b10-70fb-4edf-a9e8-0ee4f7b0fd35 tempest-VolumesActionsTest-1900412411 None] Deleted volume successfully. Sep 01 08:25:34 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.69ae61e6-3eee-4c72-b6d9-75e27101efe5" returned: 0 in 0.378s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-cada5b10-70fb-4edf-a9e8-0ee4f7b0fd35 tempest-VolumesActionsTest-1900412411 None] Lock "cinder-58b91174-2172-4826-8795-fd751b0b89d5-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e982c3-0ec9-4a33-bbec-1e6bd6098975]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:34 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140 Sep 01 08:25:34 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:34 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140" returned: 0 in 0.373s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.69ae61e6-3eee-4c72-b6d9-75e27101efe5 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:34 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.69ae61e6-3eee-4c72-b6d9-75e27101efe5 Sep 01 08:25:34 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] Flow 'volume_create_manager' (7ffbbf48-07d7-4343-bfb7-9621953502df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81725a74-0104-4fa9-8fe8-428aa0addfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81725a74-0104-4fa9-8fe8-428aa0addfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-48922420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcbe78b7-74c8-4e43-8fc9-36858a06aa8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc289e2f30054ab38be47aef9c74a7b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:25:35Z,use_quota=True,user_id='2451cf693429479fa1a93b69c3a8b31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa09a51-1575-4516-875b-8e429e9a80cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa09a51-1575-4516-875b-8e429e9a80cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca6d2c3-a203-448c-8779-5ea6c5e86e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca6d2c3-a203-448c-8779-5ea6c5e86e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcbe78b7-74c8-4e43-8fc9-36858a06aa8d', 'volume_name': 'volume-bcbe78b7-74c8-4e43-8fc9-36858a06aa8d', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (904758b0-1537-42cf-9d37-743638aa6550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (904758b0-1537-42cf-9d37-743638aa6550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (929ecbd8-1539-40e9-8003-f2a204edaddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:34 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] Volume bcbe78b7-74c8-4e43-8fc9-36858a06aa8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcbe78b7-74c8-4e43-8fc9-36858a06aa8d', 'volume_size': 1} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-48922420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcbe78b7-74c8-4e43-8fc9-36858a06aa8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc289e2f30054ab38be47aef9c74a7b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:25:35Z,use_quota=True,user_id='2451cf693429479fa1a93b69c3a8b31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] Creating volume bcbe78b7-74c8-4e43-8fc9-36858a06aa8d {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:25:34 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:25:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bcbe78b7-74c8-4e43-8fc9-36858a06aa8d 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:34 devstack sudo[100031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bcbe78b7-74c8-4e43-8fc9-36858a06aa8d 1073741824 Sep 01 08:25:34 devstack sudo[100031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:35 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.69ae61e6-3eee-4c72-b6d9-75e27101efe5" returned: 0 in 0.377s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.69ae61e6-3eee-4c72-b6d9-75e27101efe5 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:35 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.69ae61e6-3eee-4c72-b6d9-75e27101efe5 Sep 01 08:25:35 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:35 devstack sudo[100031]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bcbe78b7-74c8-4e43-8fc9-36858a06aa8d 1073741824" returned: 0 in 0.443s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bcbe78b7-74c8-4e43-8fc9-36858a06aa8d {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:35 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.69ae61e6-3eee-4c72-b6d9-75e27101efe5" returned: 0 in 0.273s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:35 devstack sudo[100043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bcbe78b7-74c8-4e43-8fc9-36858a06aa8d Sep 01 08:25:35 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-quobyte-69ae61e6-3eee-4c72-b6d9-75e27101efe5" released by "_delete_snapshot" :: held 1.504s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-quobyte-06a9fd79-0c15-4dc3-8de7-eb9c56e12773" released by "delete_snapshot" :: held 1.526s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:35 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Created reservations ['5d7f55e9-de8d-4f1e-b1a4-085b0953a0de', '03dbd03c-db3d-474d-b686-1f4c00ab1ecc', '1e5e90cf-2dfb-4a00-88e4-2529bfd63762', 'a74f6dad-0f21-4667-bb42-940675525245'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:25:35 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Delete snapshot completed successfully. Sep 01 08:25:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-69ae61e6-3eee-4c72-b6d9-75e27101efe5-delete_snapshot" released by "delete_snapshot" :: held 1.683s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Acquiring lock "cinder-e398f410-f4ab-4ba7-bec1-3c12b4593140-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-e398f410-f4ab-4ba7-bec1-3c12b4593140-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Acquiring lock "cinder-quobyte-06a9fd79-0c15-4dc3-8de7-eb9c56e12773" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-quobyte-06a9fd79-0c15-4dc3-8de7-eb9c56e12773" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Acquiring lock "cinder-quobyte-e398f410-f4ab-4ba7-bec1-3c12b4593140" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-quobyte-e398f410-f4ab-4ba7-bec1-3c12b4593140" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Deleting offline snapshot e398f410-f4ab-4ba7-bec1-3c12b4593140 of volume 06a9fd79-0c15-4dc3-8de7-eb9c56e12773 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:25:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] snapshot_file for this snap is: volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:25:35 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bcbe78b7-74c8-4e43-8fc9-36858a06aa8d" returned: 0 in 0.263s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:25:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:35 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[6942a2fc-03e7-4d2c-9fce-edf667c35377]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:25:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:35 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (929ecbd8-1539-40e9-8003-f2a204edaddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcbe78b7-74c8-4e43-8fc9-36858a06aa8d', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:35 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0333b771-a268-4030-ad25-2e161ce62449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:35 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] Volume volume-bcbe78b7-74c8-4e43-8fc9-36858a06aa8d (bcbe78b7-74c8-4e43-8fc9-36858a06aa8d): created successfully Sep 01 08:25:35 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0333b771-a268-4030-ad25-2e161ce62449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:35 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] Flow 'volume_create_manager' (7ffbbf48-07d7-4343-bfb7-9621953502df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:25:35 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-4cfe871d-16b1-4219-b74c-6b200cb27f14 tempest-VolumesActionsTest-620852510 None] Created volume successfully. Sep 01 08:25:35 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140 Sep 01 08:25:35 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-77d3939e-b926-4e27-bd76-bd00ead42aab tempest-VolumesActionsTest-1900412411 None] Acquiring lock "cinder-bcbe78b7-74c8-4e43-8fc9-36858a06aa8d-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:36 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-77d3939e-b926-4e27-bd76-bd00ead42aab tempest-VolumesActionsTest-1900412411 None] Lock "cinder-bcbe78b7-74c8-4e43-8fc9-36858a06aa8d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:36 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140" returned: 0 in 0.412s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:25:36 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[e217e902-38b8-47ff-b815-43fd803cdbed]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:25:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:36 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-77d3939e-b926-4e27-bd76-bd00ead42aab tempest-VolumesActionsTest-1900412411 None] Acquiring lock "cinder-quobyte-bcbe78b7-74c8-4e43-8fc9-36858a06aa8d" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:36 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-77d3939e-b926-4e27-bd76-bd00ead42aab tempest-VolumesActionsTest-1900412411 None] Lock "cinder-quobyte-bcbe78b7-74c8-4e43-8fc9-36858a06aa8d" acquired by "delete_volume" :: waited 0.017s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:36 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6bcbc9-601c-4a19-b4c7-12e3d6f2cc6f]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:25:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-77d3939e-b926-4e27-bd76-bd00ead42aab tempest-VolumesActionsTest-1900412411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bcbe78b7-74c8-4e43-8fc9-36858a06aa8d {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:36 devstack sudo[100051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773 Sep 01 08:25:36 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:36 devstack sudo[100052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bcbe78b7-74c8-4e43-8fc9-36858a06aa8d Sep 01 08:25:36 devstack sudo[100052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:36 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773" returned: 0 in 0.358s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:36 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140 Sep 01 08:25:36 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:36 devstack sudo[100052]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-77d3939e-b926-4e27-bd76-bd00ead42aab tempest-VolumesActionsTest-1900412411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bcbe78b7-74c8-4e43-8fc9-36858a06aa8d" returned: 0 in 0.391s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-77d3939e-b926-4e27-bd76-bd00ead42aab tempest-VolumesActionsTest-1900412411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bcbe78b7-74c8-4e43-8fc9-36858a06aa8d {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:36 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bcbe78b7-74c8-4e43-8fc9-36858a06aa8d Sep 01 08:25:36 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:36 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140" returned: 0 in 0.334s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:36 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-77d3939e-b926-4e27-bd76-bd00ead42aab tempest-VolumesActionsTest-1900412411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-bcbe78b7-74c8-4e43-8fc9-36858a06aa8d" returned: 0 in 0.259s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:36 devstack sudo[100070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140 Sep 01 08:25:36 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:36 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-77d3939e-b926-4e27-bd76-bd00ead42aab tempest-VolumesActionsTest-1900412411 None] Lock "cinder-quobyte-bcbe78b7-74c8-4e43-8fc9-36858a06aa8d" released by "delete_volume" :: held 0.690s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:36 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-77d3939e-b926-4e27-bd76-bd00ead42aab tempest-VolumesActionsTest-1900412411 None] Created reservations ['959990ec-8e2e-4f7b-81de-d58410c3c282', '36bbdea0-3fcd-4b97-92e2-ac5674109ec3', '69ba64a4-5363-45f3-a202-948a0aced473', '10ab2058-5aae-4a7d-866d-ed0306b08b4a'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:25:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-77d3939e-b926-4e27-bd76-bd00ead42aab tempest-VolumesActionsTest-1900412411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-77d3939e-b926-4e27-bd76-bd00ead42aab tempest-VolumesActionsTest-1900412411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-77d3939e-b926-4e27-bd76-bd00ead42aab tempest-VolumesActionsTest-1900412411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:25:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-77d3939e-b926-4e27-bd76-bd00ead42aab tempest-VolumesActionsTest-1900412411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:25:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-77d3939e-b926-4e27-bd76-bd00ead42aab tempest-VolumesActionsTest-1900412411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-77d3939e-b926-4e27-bd76-bd00ead42aab tempest-VolumesActionsTest-1900412411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:36 devstack sudo[100072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:25:36 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:37 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773.e398f410-f4ab-4ba7-bec1-3c12b4593140" returned: 0 in 0.256s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-quobyte-e398f410-f4ab-4ba7-bec1-3c12b4593140" released by "_delete_snapshot" :: held 1.474s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-quobyte-06a9fd79-0c15-4dc3-8de7-eb9c56e12773" released by "delete_snapshot" :: held 1.503s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Created reservations ['112d3a87-5a60-4a5c-a9c6-4131d7e974e5', '2e20c32f-a6d5-4374-9e0c-59f8f5400091', '6bfa2134-c121-4248-bd88-c9df27a87939', 'a04d9622-f691-4a8c-81be-373f0ee32e6a'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:25:37 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-77d3939e-b926-4e27-bd76-bd00ead42aab tempest-VolumesActionsTest-1900412411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.273s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-77d3939e-b926-4e27-bd76-bd00ead42aab tempest-VolumesActionsTest-1900412411 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:25:37 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-77d3939e-b926-4e27-bd76-bd00ead42aab tempest-VolumesActionsTest-1900412411 None] Deleted volume successfully. Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-77d3939e-b926-4e27-bd76-bd00ead42aab tempest-VolumesActionsTest-1900412411 None] Lock "cinder-bcbe78b7-74c8-4e43-8fc9-36858a06aa8d-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:37 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Delete snapshot completed successfully. Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-e398f410-f4ab-4ba7-bec1-3c12b4593140-delete_snapshot" released by "delete_snapshot" :: held 1.703s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Snapshots deleted, issuing volume delete {{(pid=86893) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Acquiring lock "cinder-quobyte-06a9fd79-0c15-4dc3-8de7-eb9c56e12773" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-quobyte-06a9fd79-0c15-4dc3-8de7-eb9c56e12773" acquired by "delete_volume" :: waited 0.015s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[453d178c-51ee-4f43-979a-e4609fae47da]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:37 devstack sudo[100077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773 Sep 01 08:25:37 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:25:37 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] Flow 'volume_create_manager' (da3bd2f5-73cb-4ff8-a938-6e311c462d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4898c294-b2a5-4fc4-ad72-a79194c1ca80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773" returned: 0 in 0.416s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4898c294-b2a5-4fc4-ad72-a79194c1ca80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-721047730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dc7c070-c176-44e6-b012-9e7b4debcb76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc289e2f30054ab38be47aef9c74a7b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:25:38Z,use_quota=True,user_id='2451cf693429479fa1a93b69c3a8b31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2be176a-5e0c-4aa5-ac45-715672d94699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:37 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773 Sep 01 08:25:37 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2be176a-5e0c-4aa5-ac45-715672d94699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3ddbb90-941b-4239-aff1-17c8e4b4e074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3ddbb90-941b-4239-aff1-17c8e4b4e074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dc7c070-c176-44e6-b012-9e7b4debcb76', 'volume_name': 'volume-0dc7c070-c176-44e6-b012-9e7b4debcb76', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26709c68-dc96-4911-9b3c-6b3cd05661e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26709c68-dc96-4911-9b3c-6b3cd05661e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8751c326-f913-4a01-8e05-56d888cc0ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:37 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] Volume 0dc7c070-c176-44e6-b012-9e7b4debcb76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dc7c070-c176-44e6-b012-9e7b4debcb76', 'volume_size': 1} Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-721047730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dc7c070-c176-44e6-b012-9e7b4debcb76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc289e2f30054ab38be47aef9c74a7b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:25:38Z,use_quota=True,user_id='2451cf693429479fa1a93b69c3a8b31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] Creating volume 0dc7c070-c176-44e6-b012-9e7b4debcb76 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:25:37 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0dc7c070-c176-44e6-b012-9e7b4debcb76 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:37 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0dc7c070-c176-44e6-b012-9e7b4debcb76 1073741824 Sep 01 08:25:37 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:37 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-06a9fd79-0c15-4dc3-8de7-eb9c56e12773" returned: 0 in 0.252s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-quobyte-06a9fd79-0c15-4dc3-8de7-eb9c56e12773" released by "delete_volume" :: held 0.726s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Created reservations ['20c0ae99-bbbe-4cf3-a3ab-c74dc17ff78f', 'ae92d466-5ef1-445e-84d0-488f878ef882', '65d60a0e-dbdf-40cd-ae6e-7e3c2919f486', '514f523c-6f2f-48df-94ce-b0d6f62c83d7'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:38 devstack sudo[100090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:25:38 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:38 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0dc7c070-c176-44e6-b012-9e7b4debcb76 1073741824" returned: 0 in 0.488s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0dc7c070-c176-44e6-b012-9e7b4debcb76 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:38 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0dc7c070-c176-44e6-b012-9e7b4debcb76 Sep 01 08:25:38 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:38 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.268s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:25:38 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Deleted volume successfully. Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-10b7788f-8211-4aee-b879-94adc1d56aab tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-06a9fd79-0c15-4dc3-8de7-eb9c56e12773-delete_volume" released by "delete_volume" :: held 4.650s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:38 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0dc7c070-c176-44e6-b012-9e7b4debcb76" returned: 0 in 0.266s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8751c326-f913-4a01-8e05-56d888cc0ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dc7c070-c176-44e6-b012-9e7b4debcb76', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a7301a7-5511-4388-8ef6-71bbe7d4c363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:38 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] Volume volume-0dc7c070-c176-44e6-b012-9e7b4debcb76 (0dc7c070-c176-44e6-b012-9e7b4debcb76): created successfully Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a7301a7-5511-4388-8ef6-71bbe7d4c363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] Flow 'volume_create_manager' (da3bd2f5-73cb-4ff8-a938-6e311c462d0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:25:38 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-ebcee73a-8cc1-4d48-a379-d2859b097afc tempest-VolumesActionsTest-620852510 None] Created volume successfully. Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] Flow 'volume_create_manager' (596654e8-73e8-4439-8b7d-4e456079e6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a0ee59-1047-4720-80ab-cafbc9f8c2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a0ee59-1047-4720-80ab-cafbc9f8c2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1329587854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c70f379e-8c63-4509-841c-f512482f053f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f298370bb9140368ac2d59e081be57f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:25:39Z,use_quota=True,user_id='2b3126a6bf2e4fd09e768e7ce9f1264e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b42f598e-1296-41f8-979a-190a3c0343dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b42f598e-1296-41f8-979a-190a3c0343dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b9baa1-085d-4b2b-9e52-fac46aa5f634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b9baa1-085d-4b2b-9e52-fac46aa5f634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c70f379e-8c63-4509-841c-f512482f053f', 'volume_name': 'volume-c70f379e-8c63-4509-841c-f512482f053f', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767ae603-6ab2-4f59-a7ee-cc624435bdff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767ae603-6ab2-4f59-a7ee-cc624435bdff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92784a92-f324-4f3a-906f-8e0ee28c4a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:38 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] Volume c70f379e-8c63-4509-841c-f512482f053f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c70f379e-8c63-4509-841c-f512482f053f', 'volume_size': 1} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1329587854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c70f379e-8c63-4509-841c-f512482f053f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f298370bb9140368ac2d59e081be57f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:25:39Z,use_quota=True,user_id='2b3126a6bf2e4fd09e768e7ce9f1264e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] Creating volume c70f379e-8c63-4509-841c-f512482f053f {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:25:38 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:25:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:38 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f 1073741824 Sep 01 08:25:38 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:39 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f 1073741824" returned: 0 in 0.403s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:39 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f Sep 01 08:25:39 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:39 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f" returned: 0 in 0.244s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:25:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92784a92-f324-4f3a-906f-8e0ee28c4a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c70f379e-8c63-4509-841c-f512482f053f', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e463b501-5fa5-4891-879b-677bc62c408e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:39 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] Volume volume-c70f379e-8c63-4509-841c-f512482f053f (c70f379e-8c63-4509-841c-f512482f053f): created successfully Sep 01 08:25:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e463b501-5fa5-4891-879b-677bc62c408e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] Flow 'volume_create_manager' (596654e8-73e8-4439-8b7d-4e456079e6cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:25:39 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-2334bcaf-f09c-423f-bc91-25ad4275af00 tempest-VolumesDeleteCascade-766405974 None] Created volume successfully. Sep 01 08:25:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-c5cd12b0-ee30-49a1-a000-777ea27351f1 tempest-VolumesActionsTest-1900412411 None] Acquiring lock "cinder-0dc7c070-c176-44e6-b012-9e7b4debcb76-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-c5cd12b0-ee30-49a1-a000-777ea27351f1 tempest-VolumesActionsTest-1900412411 None] Lock "cinder-0dc7c070-c176-44e6-b012-9e7b4debcb76-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7b1ec3ac-4c7d-41ae-a0a2-d6d293ff0c5c tempest-VolumesDeleteCascade-766405974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7b1ec3ac-4c7d-41ae-a0a2-d6d293ff0c5c tempest-VolumesDeleteCascade-766405974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-c5cd12b0-ee30-49a1-a000-777ea27351f1 tempest-VolumesActionsTest-1900412411 None] Acquiring lock "cinder-quobyte-0dc7c070-c176-44e6-b012-9e7b4debcb76" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-7b1ec3ac-4c7d-41ae-a0a2-d6d293ff0c5c tempest-VolumesDeleteCascade-766405974 None] Creating offline snapshot 838aacb4-8909-4ed5-b598-5d669e2a411d of volume c70f379e-8c63-4509-841c-f512482f053f {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:25:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-c5cd12b0-ee30-49a1-a000-777ea27351f1 tempest-VolumesActionsTest-1900412411 None] Lock "cinder-quobyte-0dc7c070-c176-44e6-b012-9e7b4debcb76" acquired by "delete_volume" :: waited 0.024s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:40 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[478bd9be-4ce6-4960-a932-8aab7fbde972]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:25:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7b1ec3ac-4c7d-41ae-a0a2-d6d293ff0c5c tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:40 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[241f9edd-0b76-465c-afb3-3c6da6373bb9]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:25:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5cd12b0-ee30-49a1-a000-777ea27351f1 tempest-VolumesActionsTest-1900412411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0dc7c070-c176-44e6-b012-9e7b4debcb76 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:40 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f Sep 01 08:25:40 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:40 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0dc7c070-c176-44e6-b012-9e7b4debcb76 Sep 01 08:25:40 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:40 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7b1ec3ac-4c7d-41ae-a0a2-d6d293ff0c5c tempest-VolumesDeleteCascade-766405974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f" returned: 0 in 0.368s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7b1ec3ac-4c7d-41ae-a0a2-d6d293ff0c5c tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f.838aacb4-8909-4ed5-b598-5d669e2a411d 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:40 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5cd12b0-ee30-49a1-a000-777ea27351f1 tempest-VolumesActionsTest-1900412411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0dc7c070-c176-44e6-b012-9e7b4debcb76" returned: 0 in 0.362s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5cd12b0-ee30-49a1-a000-777ea27351f1 tempest-VolumesActionsTest-1900412411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0dc7c070-c176-44e6-b012-9e7b4debcb76 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:40 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f.838aacb4-8909-4ed5-b598-5d669e2a411d 1G Sep 01 08:25:40 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:40 devstack sudo[100117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0dc7c070-c176-44e6-b012-9e7b4debcb76 Sep 01 08:25:40 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:40 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5cd12b0-ee30-49a1-a000-777ea27351f1 tempest-VolumesActionsTest-1900412411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0dc7c070-c176-44e6-b012-9e7b4debcb76" returned: 0 in 0.249s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:40 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-c5cd12b0-ee30-49a1-a000-777ea27351f1 tempest-VolumesActionsTest-1900412411 None] Lock "cinder-quobyte-0dc7c070-c176-44e6-b012-9e7b4debcb76" released by "delete_volume" :: held 0.660s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:40 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-c5cd12b0-ee30-49a1-a000-777ea27351f1 tempest-VolumesActionsTest-1900412411 None] Created reservations ['1067bc6c-662b-4049-be81-7a1678e69395', 'bfdd6b7b-6e9c-4136-8059-4bbe2fa35871', '0004953d-3992-4f4d-b7e4-d3ffa675307c', '7f2036f6-db12-4977-bffc-850cc2c38271'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:25:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c5cd12b0-ee30-49a1-a000-777ea27351f1 tempest-VolumesActionsTest-1900412411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c5cd12b0-ee30-49a1-a000-777ea27351f1 tempest-VolumesActionsTest-1900412411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:40 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c5cd12b0-ee30-49a1-a000-777ea27351f1 tempest-VolumesActionsTest-1900412411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:25:40 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c5cd12b0-ee30-49a1-a000-777ea27351f1 tempest-VolumesActionsTest-1900412411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:25:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c5cd12b0-ee30-49a1-a000-777ea27351f1 tempest-VolumesActionsTest-1900412411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5cd12b0-ee30-49a1-a000-777ea27351f1 tempest-VolumesActionsTest-1900412411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:40 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7b1ec3ac-4c7d-41ae-a0a2-d6d293ff0c5c tempest-VolumesDeleteCascade-766405974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f.838aacb4-8909-4ed5-b598-5d669e2a411d 1G" returned: 0 in 0.420s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7b1ec3ac-4c7d-41ae-a0a2-d6d293ff0c5c tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c70f379e-8c63-4509-841c-f512482f053f -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f.838aacb4-8909-4ed5-b598-5d669e2a411d {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:40 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:25:40 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:40 devstack sudo[100127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c70f379e-8c63-4509-841c-f512482f053f -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f.838aacb4-8909-4ed5-b598-5d669e2a411d Sep 01 08:25:40 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:41 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5cd12b0-ee30-49a1-a000-777ea27351f1 tempest-VolumesActionsTest-1900412411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.277s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-c5cd12b0-ee30-49a1-a000-777ea27351f1 tempest-VolumesActionsTest-1900412411 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:25:41 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-c5cd12b0-ee30-49a1-a000-777ea27351f1 tempest-VolumesActionsTest-1900412411 None] Deleted volume successfully. Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-c5cd12b0-ee30-49a1-a000-777ea27351f1 tempest-VolumesActionsTest-1900412411 None] Lock "cinder-0dc7c070-c176-44e6-b012-9e7b4debcb76-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:41 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7b1ec3ac-4c7d-41ae-a0a2-d6d293ff0c5c tempest-VolumesDeleteCascade-766405974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c70f379e-8c63-4509-841c-f512482f053f -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f.838aacb4-8909-4ed5-b598-5d669e2a411d" returned: 0 in 0.336s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:41 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-7b1ec3ac-4c7d-41ae-a0a2-d6d293ff0c5c tempest-VolumesDeleteCascade-766405974 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f.838aacb4-8909-4ed5-b598-5d669e2a411d is being set with open permissions: ugo+rw Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7b1ec3ac-4c7d-41ae-a0a2-d6d293ff0c5c tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f.838aacb4-8909-4ed5-b598-5d669e2a411d {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:41 devstack sudo[100133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f.838aacb4-8909-4ed5-b598-5d669e2a411d Sep 01 08:25:41 devstack sudo[100133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:41 devstack sudo[100133]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7b1ec3ac-4c7d-41ae-a0a2-d6d293ff0c5c tempest-VolumesDeleteCascade-766405974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f.838aacb4-8909-4ed5-b598-5d669e2a411d" returned: 0 in 0.256s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7b1ec3ac-4c7d-41ae-a0a2-d6d293ff0c5c tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:41 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f.info Sep 01 08:25:41 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] Flow 'volume_create_manager' (031de1ba-a5f6-4779-b0e4-01cafbcad93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef77055-c3e5-4869-a5b2-44e610d71e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef77055-c3e5-4869-a5b2-44e610d71e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1223558317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=627ccfd3-4131-4df4-a095-a82f6c7bbff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc289e2f30054ab38be47aef9c74a7b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:25:42Z,use_quota=True,user_id='2451cf693429479fa1a93b69c3a8b31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68328fc-64ca-4d24-91ab-e49b89f5fa0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68328fc-64ca-4d24-91ab-e49b89f5fa0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e79b66d-b933-4fa5-bb0b-06a7c7bccc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e79b66d-b933-4fa5-bb0b-06a7c7bccc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '627ccfd3-4131-4df4-a095-a82f6c7bbff8', 'volume_name': 'volume-627ccfd3-4131-4df4-a095-a82f6c7bbff8', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5349366c-bcee-409d-99f2-4dfb2a691701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5349366c-bcee-409d-99f2-4dfb2a691701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27f8048-5bc4-4104-b697-a772a48cf5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:41 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] Volume 627ccfd3-4131-4df4-a095-a82f6c7bbff8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-627ccfd3-4131-4df4-a095-a82f6c7bbff8', 'volume_size': 1} Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:41 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7b1ec3ac-4c7d-41ae-a0a2-d6d293ff0c5c tempest-VolumesDeleteCascade-766405974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f.info" returned: 0 in 0.258s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:41 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-7b1ec3ac-4c7d-41ae-a0a2-d6d293ff0c5c tempest-VolumesDeleteCascade-766405974 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f.info is being set with open permissions: ugo+rw Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7b1ec3ac-4c7d-41ae-a0a2-d6d293ff0c5c tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:41 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f.info Sep 01 08:25:41 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:41 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7b1ec3ac-4c7d-41ae-a0a2-d6d293ff0c5c tempest-VolumesDeleteCascade-766405974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f.info" returned: 0 in 0.243s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7b1ec3ac-4c7d-41ae-a0a2-d6d293ff0c5c tempest-VolumesDeleteCascade-766405974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.968s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.307s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1223558317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=627ccfd3-4131-4df4-a095-a82f6c7bbff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc289e2f30054ab38be47aef9c74a7b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:25:42Z,use_quota=True,user_id='2451cf693429479fa1a93b69c3a8b31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] Creating volume 627ccfd3-4131-4df4-a095-a82f6c7bbff8 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:25:41 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:25:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-627ccfd3-4131-4df4-a095-a82f6c7bbff8 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:41 devstack sudo[100142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-627ccfd3-4131-4df4-a095-a82f6c7bbff8 1073741824 Sep 01 08:25:41 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:41 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-7b1ec3ac-4c7d-41ae-a0a2-d6d293ff0c5c tempest-VolumesDeleteCascade-766405974 None] Create snapshot completed successfully Sep 01 08:25:42 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-627ccfd3-4131-4df4-a095-a82f6c7bbff8 1073741824" returned: 0 in 0.439s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-627ccfd3-4131-4df4-a095-a82f6c7bbff8 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:42 devstack sudo[100148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-627ccfd3-4131-4df4-a095-a82f6c7bbff8 Sep 01 08:25:42 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Flow 'volume_create_manager' (7ce8b0ac-e4f6-4556-980e-f1aa2625a78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f85242-de0a-4496-892b-665ea78fb5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f85242-de0a-4496-892b-665ea78fb5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2074270823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=139a6b97-3372-49c3-8f6d-830250176036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f298370bb9140368ac2d59e081be57f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=838aacb4-8909-4ed5-b598-5d669e2a411d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:25:43Z,use_quota=True,user_id='2b3126a6bf2e4fd09e768e7ce9f1264e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8542ff6b-3f7c-48bc-b4fd-d06bd4b6807b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8542ff6b-3f7c-48bc-b4fd-d06bd4b6807b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e269e0d-7144-4f70-a0c3-6cc0fc03ee87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e269e0d-7144-4f70-a0c3-6cc0fc03ee87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '139a6b97-3372-49c3-8f6d-830250176036', 'volume_name': 'volume-139a6b97-3372-49c3-8f6d-830250176036', 'volume_size': 1, 'snapshot_id': '838aacb4-8909-4ed5-b598-5d669e2a411d'}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9def347e-23b9-4e7d-92e3-382f3c5cd4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9def347e-23b9-4e7d-92e3-382f3c5cd4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:42 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f0c1480-2230-4174-a226-300b83605d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:42 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Volume 139a6b97-3372-49c3-8f6d-830250176036: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-139a6b97-3372-49c3-8f6d-830250176036', 'volume_size': 1, 'snapshot_id': '838aacb4-8909-4ed5-b598-5d669e2a411d'} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-627ccfd3-4131-4df4-a095-a82f6c7bbff8" returned: 0 in 0.277s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Acquiring lock "cinder-quobyte-838aacb4-8909-4ed5-b598-5d669e2a411d-139a6b97-3372-49c3-8f6d-830250176036" by "_create_volume_from_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27f8048-5bc4-4104-b697-a772a48cf5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-627ccfd3-4131-4df4-a095-a82f6c7bbff8', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af988ce-f093-4229-862e-2ccda95288d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-quobyte-838aacb4-8909-4ed5-b598-5d669e2a411d-139a6b97-3372-49c3-8f6d-830250176036" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Creating volume 139a6b97-3372-49c3-8f6d-830250176036 from snapshot 838aacb4-8909-4ed5-b598-5d669e2a411d {{(pid=86893) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Acquiring lock "cinder-quobyte-139a6b97-3372-49c3-8f6d-830250176036" by "_copy_volume_from_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:42 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] Volume volume-627ccfd3-4131-4df4-a095-a82f6c7bbff8 (627ccfd3-4131-4df4-a095-a82f6c7bbff8): created successfully Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af988ce-f093-4229-862e-2ccda95288d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] Flow 'volume_create_manager' (031de1ba-a5f6-4779-b0e4-01cafbcad93d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-quobyte-139a6b97-3372-49c3-8f6d-830250176036" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] snapshot: 838aacb4-8909-4ed5-b598-5d669e2a411d, volume: 139a6b97-3372-49c3-8f6d-830250176036, {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:42 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-7e31cf7d-5f59-49df-8dc5-6760dcec99ab tempest-VolumesActionsTest-620852510 None] Created volume successfully. Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a98c80-6c51-46d0-98c7-d291c9bbb07f]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:25:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f.838aacb4-8909-4ed5-b598-5d669e2a411d {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:42 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f.838aacb4-8909-4ed5-b598-5d669e2a411d Sep 01 08:25:42 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:43 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f.838aacb4-8909-4ed5-b598-5d669e2a411d" returned: 0 in 0.365s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:43 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c70f379e-8c63-4509-841c-f512482f053f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:25:43 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc42b95-d4ff-448a-a713-fdb9637ee9b5]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:25:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:43 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f Sep 01 08:25:43 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:43 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f" returned: 0 in 0.366s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:43 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 08:25:43 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Creating direct copy from snapshot {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 08:25:43 devstack cinder-volume[86893]: DEBUG cinder.utils [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Path /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-139a6b97-3372-49c3-8f6d-830250176036 not found in is_blk_device check {{(pid=86893) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 08:25:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-139a6b97-3372-49c3-8f6d-830250176036 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:43 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-139a6b97-3372-49c3-8f6d-830250176036 Sep 01 08:25:43 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:44 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d9dbd06f-6940-4cd3-91e5-29db3d1c92e8 tempest-VolumesActionsTest-620852510 None] Acquiring lock "cinder-627ccfd3-4131-4df4-a095-a82f6c7bbff8-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:44 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d9dbd06f-6940-4cd3-91e5-29db3d1c92e8 tempest-VolumesActionsTest-620852510 None] Lock "cinder-627ccfd3-4131-4df4-a095-a82f6c7bbff8-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:44 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d9dbd06f-6940-4cd3-91e5-29db3d1c92e8 tempest-VolumesActionsTest-620852510 None] Acquiring lock "cinder-quobyte-627ccfd3-4131-4df4-a095-a82f6c7bbff8" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:45 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d9dbd06f-6940-4cd3-91e5-29db3d1c92e8 tempest-VolumesActionsTest-620852510 None] Lock "cinder-quobyte-627ccfd3-4131-4df4-a095-a82f6c7bbff8" acquired by "delete_volume" :: waited 0.040s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:45 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[a492dc3b-5209-4b31-aae1-cc6a1406bab8]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:25:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d9dbd06f-6940-4cd3-91e5-29db3d1c92e8 tempest-VolumesActionsTest-620852510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-627ccfd3-4131-4df4-a095-a82f6c7bbff8 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:45 devstack sudo[100176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-627ccfd3-4131-4df4-a095-a82f6c7bbff8 Sep 01 08:25:45 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:46 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d9dbd06f-6940-4cd3-91e5-29db3d1c92e8 tempest-VolumesActionsTest-620852510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-627ccfd3-4131-4df4-a095-a82f6c7bbff8" returned: 0 in 0.973s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d9dbd06f-6940-4cd3-91e5-29db3d1c92e8 tempest-VolumesActionsTest-620852510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-627ccfd3-4131-4df4-a095-a82f6c7bbff8 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:46 devstack sudo[100181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-627ccfd3-4131-4df4-a095-a82f6c7bbff8 Sep 01 08:25:46 devstack sudo[100181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:46 devstack sudo[100181]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d9dbd06f-6940-4cd3-91e5-29db3d1c92e8 tempest-VolumesActionsTest-620852510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-627ccfd3-4131-4df4-a095-a82f6c7bbff8" returned: 0 in 0.412s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:46 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d9dbd06f-6940-4cd3-91e5-29db3d1c92e8 tempest-VolumesActionsTest-620852510 None] Lock "cinder-quobyte-627ccfd3-4131-4df4-a095-a82f6c7bbff8" released by "delete_volume" :: held 1.482s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:46 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-d9dbd06f-6940-4cd3-91e5-29db3d1c92e8 tempest-VolumesActionsTest-620852510 None] Created reservations ['b0c391d2-2032-4a0f-8369-b472e529d7c5', 'eaa33117-c83c-450b-ab9b-8ac9cd75173f', '7347e1f0-c5f3-4168-9edd-0c8c929c9a2d', 'a6b221cb-48c9-4e16-9a4e-32e60da31c5d'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:25:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d9dbd06f-6940-4cd3-91e5-29db3d1c92e8 tempest-VolumesActionsTest-620852510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d9dbd06f-6940-4cd3-91e5-29db3d1c92e8 tempest-VolumesActionsTest-620852510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d9dbd06f-6940-4cd3-91e5-29db3d1c92e8 tempest-VolumesActionsTest-620852510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:25:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d9dbd06f-6940-4cd3-91e5-29db3d1c92e8 tempest-VolumesActionsTest-620852510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:25:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d9dbd06f-6940-4cd3-91e5-29db3d1c92e8 tempest-VolumesActionsTest-620852510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d9dbd06f-6940-4cd3-91e5-29db3d1c92e8 tempest-VolumesActionsTest-620852510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:46 devstack sudo[100184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:25:46 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:47 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d9dbd06f-6940-4cd3-91e5-29db3d1c92e8 tempest-VolumesActionsTest-620852510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.508s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:47 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-d9dbd06f-6940-4cd3-91e5-29db3d1c92e8 tempest-VolumesActionsTest-620852510 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:25:47 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-d9dbd06f-6940-4cd3-91e5-29db3d1c92e8 tempest-VolumesActionsTest-620852510 None] Deleted volume successfully. Sep 01 08:25:47 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d9dbd06f-6940-4cd3-91e5-29db3d1c92e8 tempest-VolumesActionsTest-620852510 None] Lock "cinder-627ccfd3-4131-4df4-a095-a82f6c7bbff8-delete_volume" released by "delete_volume" :: held 2.461s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:48 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-139a6b97-3372-49c3-8f6d-830250176036" returned: 0 in 4.906s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:48 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Image conversion details: src /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f, size 1024.00 MB, duration 4.91 sec, destination /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-139a6b97-3372-49c3-8f6d-830250176036 {{(pid=86893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 08:25:48 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Converted 1024.00 MB image at 208.65 MB/s Sep 01 08:25:48 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-139a6b97-3372-49c3-8f6d-830250176036 is being set with open permissions: ugo+rw Sep 01 08:25:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-139a6b97-3372-49c3-8f6d-830250176036 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:48 devstack sudo[100188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-139a6b97-3372-49c3-8f6d-830250176036 Sep 01 08:25:48 devstack sudo[100188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:48 devstack sudo[100188]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-139a6b97-3372-49c3-8f6d-830250176036" returned: 0 in 0.251s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:48 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-quobyte-139a6b97-3372-49c3-8f6d-830250176036" released by "_copy_volume_from_snapshot" :: held 5.967s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:48 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-quobyte-838aacb4-8909-4ed5-b598-5d669e2a411d-139a6b97-3372-49c3-8f6d-830250176036" released by "_create_volume_from_snapshot" :: held 6.043s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.070s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f0c1480-2230-4174-a226-300b83605d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-139a6b97-3372-49c3-8f6d-830250176036', 'volume_size': 1, 'snapshot_id': '838aacb4-8909-4ed5-b598-5d669e2a411d'}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d55944c-4392-461f-bb7d-7007b6465826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:25:48 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Volume volume-139a6b97-3372-49c3-8f6d-830250176036 (139a6b97-3372-49c3-8f6d-830250176036): created successfully Sep 01 08:25:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d55944c-4392-461f-bb7d-7007b6465826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:25:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Flow 'volume_create_manager' (7ce8b0ac-e4f6-4556-980e-f1aa2625a78a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:25:48 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-e8fbe289-c0b3-40fc-a5d2-3f25c457a960 tempest-VolumesDeleteCascade-766405974 None] Created volume successfully. Sep 01 08:25:49 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Acquiring lock "cinder-c70f379e-8c63-4509-841c-f512482f053f-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:49 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-c70f379e-8c63-4509-841c-f512482f053f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:49 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Performing cascade delete. {{(pid=86893) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 01 08:25:49 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Acquiring lock "cinder-838aacb4-8909-4ed5-b598-5d669e2a411d-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:49 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-838aacb4-8909-4ed5-b598-5d669e2a411d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:49 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Acquiring lock "cinder-quobyte-c70f379e-8c63-4509-841c-f512482f053f" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:49 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-quobyte-c70f379e-8c63-4509-841c-f512482f053f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:49 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Acquiring lock "cinder-quobyte-838aacb4-8909-4ed5-b598-5d669e2a411d" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:49 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-quobyte-838aacb4-8909-4ed5-b598-5d669e2a411d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:49 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Deleting offline snapshot 838aacb4-8909-4ed5-b598-5d669e2a411d of volume c70f379e-8c63-4509-841c-f512482f053f {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:25:49 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] snapshot_file for this snap is: volume-c70f379e-8c63-4509-841c-f512482f053f.838aacb4-8909-4ed5-b598-5d669e2a411d {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:25:49 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[78aca3b1-b227-4497-a62c-bb569f3653d4]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:25:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f.838aacb4-8909-4ed5-b598-5d669e2a411d {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:49 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f.838aacb4-8909-4ed5-b598-5d669e2a411d Sep 01 08:25:49 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:49 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f.838aacb4-8909-4ed5-b598-5d669e2a411d" returned: 0 in 0.367s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:49 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c70f379e-8c63-4509-841c-f512482f053f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:25:49 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[19083f01-d403-428f-9f5d-f384692ea6b9]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:25:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:50 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f Sep 01 08:25:50 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:50 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f" returned: 0 in 0.587s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f.838aacb4-8909-4ed5-b598-5d669e2a411d {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:50 devstack sudo[100202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f.838aacb4-8909-4ed5-b598-5d669e2a411d Sep 01 08:25:50 devstack sudo[100202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:50 devstack sudo[100202]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f.838aacb4-8909-4ed5-b598-5d669e2a411d" returned: 0 in 0.319s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f.838aacb4-8909-4ed5-b598-5d669e2a411d {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:50 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f.838aacb4-8909-4ed5-b598-5d669e2a411d Sep 01 08:25:50 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:51 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f.838aacb4-8909-4ed5-b598-5d669e2a411d" returned: 0 in 0.294s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:51 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-quobyte-838aacb4-8909-4ed5-b598-5d669e2a411d" released by "_delete_snapshot" :: held 1.672s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:51 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-quobyte-c70f379e-8c63-4509-841c-f512482f053f" released by "delete_snapshot" :: held 1.694s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:51 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Created reservations ['08fb284b-36ee-4fe5-8954-3bcf7fb3ea5e', '104b790a-3359-41d8-a5cb-044e44928c84', '7f692924-21bc-4683-98cc-239c486f3cda', '9e2ac5ac-cfb3-41a2-9435-7dbce7c78042'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:25:51 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Delete snapshot completed successfully. Sep 01 08:25:51 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-838aacb4-8909-4ed5-b598-5d669e2a411d-delete_snapshot" released by "delete_snapshot" :: held 1.864s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:51 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Snapshots deleted, issuing volume delete {{(pid=86893) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 01 08:25:51 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Acquiring lock "cinder-quobyte-c70f379e-8c63-4509-841c-f512482f053f" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:51 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-quobyte-c70f379e-8c63-4509-841c-f512482f053f" acquired by "delete_volume" :: waited 0.015s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:51 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[02320f26-4fbf-4cc9-a439-d14fbe45a978]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:25:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:51 devstack sudo[100211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f Sep 01 08:25:51 devstack sudo[100211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:51 devstack sudo[100211]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f" returned: 0 in 0.431s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:51 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f Sep 01 08:25:51 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:52 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-c70f379e-8c63-4509-841c-f512482f053f" returned: 0 in 0.271s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:52 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-quobyte-c70f379e-8c63-4509-841c-f512482f053f" released by "delete_volume" :: held 0.765s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:52 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Created reservations ['bb93dd8c-254a-43d9-a2b1-066acd29901a', '3d0b739f-fc5b-40de-874e-640f9875e10e', '92e37e39-bf78-40c1-bff1-73293ba05e17', 'b2bf402a-96ee-40a2-9cfe-eda4d9eec123'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:25:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:25:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:25:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:52 devstack sudo[100221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:25:52 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:52 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.243s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:52 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:25:52 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Deleted volume successfully. Sep 01 08:25:52 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8eadd050-c5c1-4f30-b831-26fb8c821a84 tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-c70f379e-8c63-4509-841c-f512482f053f-delete_volume" released by "delete_volume" :: held 3.092s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:52 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2ba0bcde-f5f1-41f9-8220-736aca0fae48 tempest-VolumesDeleteCascade-766405974 None] Acquiring lock "cinder-139a6b97-3372-49c3-8f6d-830250176036-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:52 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2ba0bcde-f5f1-41f9-8220-736aca0fae48 tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-139a6b97-3372-49c3-8f6d-830250176036-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:52 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2ba0bcde-f5f1-41f9-8220-736aca0fae48 tempest-VolumesDeleteCascade-766405974 None] Acquiring lock "cinder-quobyte-139a6b97-3372-49c3-8f6d-830250176036" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:25:52 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2ba0bcde-f5f1-41f9-8220-736aca0fae48 tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-quobyte-139a6b97-3372-49c3-8f6d-830250176036" acquired by "delete_volume" :: waited 0.023s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:25:52 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f06ba8-4147-4ad4-947d-8062dfacbd3c]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:25:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2ba0bcde-f5f1-41f9-8220-736aca0fae48 tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-139a6b97-3372-49c3-8f6d-830250176036 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:53 devstack sudo[100224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-139a6b97-3372-49c3-8f6d-830250176036 Sep 01 08:25:53 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:53 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2ba0bcde-f5f1-41f9-8220-736aca0fae48 tempest-VolumesDeleteCascade-766405974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-139a6b97-3372-49c3-8f6d-830250176036" returned: 0 in 0.383s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2ba0bcde-f5f1-41f9-8220-736aca0fae48 tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-139a6b97-3372-49c3-8f6d-830250176036 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:53 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-139a6b97-3372-49c3-8f6d-830250176036 Sep 01 08:25:53 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:53 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2ba0bcde-f5f1-41f9-8220-736aca0fae48 tempest-VolumesDeleteCascade-766405974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-139a6b97-3372-49c3-8f6d-830250176036" returned: 0 in 0.251s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:53 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2ba0bcde-f5f1-41f9-8220-736aca0fae48 tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-quobyte-139a6b97-3372-49c3-8f6d-830250176036" released by "delete_volume" :: held 0.681s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:25:53 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-2ba0bcde-f5f1-41f9-8220-736aca0fae48 tempest-VolumesDeleteCascade-766405974 None] Created reservations ['45117110-8984-487e-a87d-a30363313e78', 'e45ef3bc-2928-4792-899d-81c6696c1058', 'd8c0751f-d30e-4c7f-a5fa-a43b14fa55b5', 'b1582e06-9b78-4b3c-b02b-f5a31c7d7ec5'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:25:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2ba0bcde-f5f1-41f9-8220-736aca0fae48 tempest-VolumesDeleteCascade-766405974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:25:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2ba0bcde-f5f1-41f9-8220-736aca0fae48 tempest-VolumesDeleteCascade-766405974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:25:53 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2ba0bcde-f5f1-41f9-8220-736aca0fae48 tempest-VolumesDeleteCascade-766405974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:25:53 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2ba0bcde-f5f1-41f9-8220-736aca0fae48 tempest-VolumesDeleteCascade-766405974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:25:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2ba0bcde-f5f1-41f9-8220-736aca0fae48 tempest-VolumesDeleteCascade-766405974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:25:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2ba0bcde-f5f1-41f9-8220-736aca0fae48 tempest-VolumesDeleteCascade-766405974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:25:53 devstack sudo[100234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:25:53 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:25:53 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root Sep 01 08:25:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2ba0bcde-f5f1-41f9-8220-736aca0fae48 tempest-VolumesDeleteCascade-766405974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.253s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:25:53 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-2ba0bcde-f5f1-41f9-8220-736aca0fae48 tempest-VolumesDeleteCascade-766405974 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:25:53 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-2ba0bcde-f5f1-41f9-8220-736aca0fae48 tempest-VolumesDeleteCascade-766405974 None] Deleted volume successfully. Sep 01 08:25:54 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2ba0bcde-f5f1-41f9-8220-736aca0fae48 tempest-VolumesDeleteCascade-766405974 None] Lock "cinder-139a6b97-3372-49c3-8f6d-830250176036-delete_volume" released by "delete_volume" :: held 1.156s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:26:02 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:26:02 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Flow 'volume_create_manager' (a73a1271-053b-4656-87e2-bf25b0fadfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:26:02 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5af7739-1b74-40c3-b9bc-9413e4f7e3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:26:02 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5af7739-1b74-40c3-b9bc-9413e4f7e3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1052915828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3d219f-0cd8-4448-aa99-9a8e7da5af2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eced3f4e61349e7b8d3a952f8f3c341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:26:03Z,use_quota=True,user_id='f8301aff30c8482fbd10e5cda09bec17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:26:02 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad3ccccd-5e74-4e81-b0dd-c53f4c0bbe56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:26:02 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad3ccccd-5e74-4e81-b0dd-c53f4c0bbe56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:26:02 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf60ffd9-3a85-4607-ae8f-2a248a99f5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:26:02 devstack cinder-volume[86893]: DEBUG cinder.image.glance [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Creating Keystone auth plugin from conf {{(pid=86893) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 08:26:03 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf60ffd9-3a85-4607-ae8f-2a248a99f5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ba3d219f-0cd8-4448-aa99-9a8e7da5af2b', 'volume_name': 'volume-ba3d219f-0cd8-4448-aa99-9a8e7da5af2b', 'volume_size': 1, 'image_id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a80c3dd0151a4e4aacd690bfb315fb01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'created_at': datetime.datetime(2026, 9, 1, 6, 7, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 6, 7, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:26:03 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48438669-2499-40c1-87ce-4fba90c52553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:26:03 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48438669-2499-40c1-87ce-4fba90c52553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:26:03 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0449d6-4f67-47a7-b6be-84bf9c5aab64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:26:03 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Volume ba3d219f-0cd8-4448-aa99-9a8e7da5af2b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ba3d219f-0cd8-4448-aa99-9a8e7da5af2b', 'volume_size': 1, 'image_id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a80c3dd0151a4e4aacd690bfb315fb01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'created_at': datetime.datetime(2026, 9, 1, 6, 7, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 6, 7, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 08:26:03 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Trying to clone ba3d219f-0cd8-4448-aa99-9a8e7da5af2b from image 00f5a94d-dba5-4527-9ce8-7a00c3b29ced at location (None, [{'url': 'file:///opt/stack/data/glance/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'metadata': {}}]). {{(pid=86893) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1100}} Sep 01 08:26:03 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_yy5rgvp5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86893) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 08:26:03 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Image download 20.69 MB at 20.69 MB/s Sep 01 08:26:03 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[946ce47c-2ba1-45ca-b479-6b692b902f87]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:26:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_yy5rgvp5devstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:03 devstack sudo[100241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_yy5rgvp5devstack@QuobyteHD Sep 01 08:26:03 devstack sudo[100241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:03 devstack sudo[100241]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_yy5rgvp5devstack@QuobyteHD" returned: 0 in 0.381s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:03 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Temporary image 00f5a94d-dba5-4527-9ce8-7a00c3b29ced is fetched for user f8301aff30c8482fbd10e5cda09bec17. {{(pid=86893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 08:26:03 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41031e0-1a77-486b-a124-28579595e1be]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:26:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_yy5rgvp5devstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:04 devstack sudo[100246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_yy5rgvp5devstack@QuobyteHD Sep 01 08:26:04 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:04 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_yy5rgvp5devstack@QuobyteHD" returned: 0 in 0.340s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:26:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:26:04 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1052915828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3d219f-0cd8-4448-aa99-9a8e7da5af2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eced3f4e61349e7b8d3a952f8f3c341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:26:03Z,use_quota=True,user_id='f8301aff30c8482fbd10e5cda09bec17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:26:04 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Creating volume ba3d219f-0cd8-4448-aa99-9a8e7da5af2b {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:26:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:26:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:26:04 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:26:04 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:26:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:26:04 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:26:04 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:26:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ba3d219f-0cd8-4448-aa99-9a8e7da5af2b 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:04 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ba3d219f-0cd8-4448-aa99-9a8e7da5af2b 1073741824 Sep 01 08:26:04 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:04 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ba3d219f-0cd8-4448-aa99-9a8e7da5af2b 1073741824" returned: 0 in 0.465s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ba3d219f-0cd8-4448-aa99-9a8e7da5af2b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:04 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ba3d219f-0cd8-4448-aa99-9a8e7da5af2b Sep 01 08:26:04 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:05 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ba3d219f-0cd8-4448-aa99-9a8e7da5af2b" returned: 0 in 0.259s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:05 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:26:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:26:05 devstack cinder-volume[86893]: DEBUG cinder.volume.volume_utils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Attempting download of 00f5a94d-dba5-4527-9ce8-7a00c3b29ced ((None, [{'url': 'file:///opt/stack/data/glance/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'metadata': {}}])) to volume ba3d219f-0cd8-4448-aa99-9a8e7da5af2b. {{(pid=86893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 08:26:05 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0ca69d-8ed7-4412-b935-5b5a7fe7f2e4]: (4, 'raw') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:26:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_y3uissi2 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:05 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_y3uissi2 Sep 01 08:26:05 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:05 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_y3uissi2" returned: 0 in 0.366s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_y3uissi2 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:05 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_y3uissi2 Sep 01 08:26:05 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:05 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_y3uissi2" returned: 1 in 0.340s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_y3uissi2' failed. Not Retrying. {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 08:26:05 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74e7364-ef14-4eae-a78e-814130ea074e]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:26:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_yy5rgvp5devstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:06 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_yy5rgvp5devstack@QuobyteHD Sep 01 08:26:06 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:06 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:06 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_yy5rgvp5devstack@QuobyteHD" returned: 0 in 0.412s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:06 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] 00f5a94d-dba5-4527-9ce8-7a00c3b29ced was qcow2, converting to qcow2 {{(pid=86893) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 08:26:06 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_yy5rgvp5devstack@QuobyteHD /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ba3d219f-0cd8-4448-aa99-9a8e7da5af2b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:06 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_yy5rgvp5devstack@QuobyteHD /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ba3d219f-0cd8-4448-aa99-9a8e7da5af2b Sep 01 08:26:06 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:06 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:26:06 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] Flow 'volume_create_manager' (2dc9e936-39a5-477b-94f5-8de21ad76c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:26:06 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3af3d22-b099-4725-ba48-a8cf127d3062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:26:06 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3af3d22-b099-4725-ba48-a8cf127d3062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-343856677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf5ef65-2af2-44c2-bb36-156373d4a02a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c46daa5b22942889167bc4c68352cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:26:07Z,use_quota=True,user_id='53e518a12d1443b6ad150b6c5fcc1fd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:26:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f33774f-602e-40ba-bf96-1270e48390c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:26:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f33774f-602e-40ba-bf96-1270e48390c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:26:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015a9728-fc21-4a36-8702-4cb9d38dc630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:26:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015a9728-fc21-4a36-8702-4cb9d38dc630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cf5ef65-2af2-44c2-bb36-156373d4a02a', 'volume_name': 'volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:26:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460afc6e-3518-4289-9e36-3130c6580128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:26:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460afc6e-3518-4289-9e36-3130c6580128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:26:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6b3105-d424-4dff-8356-74047a2826bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:26:07 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] Volume 1cf5ef65-2af2-44c2-bb36-156373d4a02a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a', 'volume_size': 1} Sep 01 08:26:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:26:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:26:07 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-343856677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf5ef65-2af2-44c2-bb36-156373d4a02a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c46daa5b22942889167bc4c68352cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:26:07Z,use_quota=True,user_id='53e518a12d1443b6ad150b6c5fcc1fd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:26:07 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] Creating volume 1cf5ef65-2af2-44c2-bb36-156373d4a02a {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:26:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:26:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:26:07 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:26:07 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:26:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:26:07 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:26:07 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:26:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:07 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a 1073741824 Sep 01 08:26:07 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:07 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a 1073741824" returned: 0 in 0.515s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:07 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a Sep 01 08:26:07 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:07 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a" returned: 0 in 0.272s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:07 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:26:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:26:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6b3105-d424-4dff-8356-74047a2826bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:26:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ab8561-1215-46bf-b99c-141ba6b3f6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:26:07 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] Volume volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a (1cf5ef65-2af2-44c2-bb36-156373d4a02a): created successfully Sep 01 08:26:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ab8561-1215-46bf-b99c-141ba6b3f6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:26:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] Flow 'volume_create_manager' (2dc9e936-39a5-477b-94f5-8de21ad76c7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:26:07 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-2009d0bb-3ecd-47ea-9c9c-b6ced7d716c7 tempest-VolumesActionsTest-1846254690 None] Created volume successfully. Sep 01 08:26:08 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_yy5rgvp5devstack@QuobyteHD /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ba3d219f-0cd8-4448-aa99-9a8e7da5af2b" returned: 0 in 1.927s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:08 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_yy5rgvp5devstack@QuobyteHD, size 112.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ba3d219f-0cd8-4448-aa99-9a8e7da5af2b {{(pid=86893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 08:26:08 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Converted 112.00 MB image at 58.09 MB/s Sep 01 08:26:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ba3d219f-0cd8-4448-aa99-9a8e7da5af2b 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:08 devstack sudo[100292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ba3d219f-0cd8-4448-aa99-9a8e7da5af2b 1G Sep 01 08:26:08 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:08 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ba3d219f-0cd8-4448-aa99-9a8e7da5af2b 1G" returned: 0 in 0.304s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:08 devstack cinder-volume[86893]: DEBUG cinder.volume.volume_utils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Downloaded image 00f5a94d-dba5-4527-9ce8-7a00c3b29ced ((None, [{'url': 'file:///opt/stack/data/glance/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'metadata': {}}])) to volume ba3d219f-0cd8-4448-aa99-9a8e7da5af2b successfully. {{(pid=86893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 08:26:08 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Temporary image 00f5a94d-dba5-4527-9ce8-7a00c3b29ced for user f8301aff30c8482fbd10e5cda09bec17 is deleted. {{(pid=86893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 08:26:08 devstack cinder-volume[86893]: DEBUG cinder.volume.volume_utils [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Marking volume ba3d219f-0cd8-4448-aa99-9a8e7da5af2b as bootable. {{(pid=86893) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 08:26:08 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Copying metadata from image 00f5a94d-dba5-4527-9ce8-7a00c3b29ced to ba3d219f-0cd8-4448-aa99-9a8e7da5af2b. {{(pid=86893) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 08:26:08 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Creating volume glance metadata for volume ba3d219f-0cd8-4448-aa99-9a8e7da5af2b backed by image 00f5a94d-dba5-4527-9ce8-7a00c3b29ced with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86893) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 08:26:08 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0449d6-4f67-47a7-b6be-84bf9c5aab64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba3d219f-0cd8-4448-aa99-9a8e7da5af2b', 'volume_size': 1, 'image_id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a80c3dd0151a4e4aacd690bfb315fb01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'created_at': datetime.datetime(2026, 9, 1, 6, 7, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 6, 7, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:26:08 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8107095e-6f1e-4245-9596-fce37f7ea53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:26:08 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Volume volume-ba3d219f-0cd8-4448-aa99-9a8e7da5af2b (ba3d219f-0cd8-4448-aa99-9a8e7da5af2b): created successfully Sep 01 08:26:08 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8107095e-6f1e-4245-9596-fce37f7ea53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:26:08 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Flow 'volume_create_manager' (a73a1271-053b-4656-87e2-bf25b0fadfab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:26:08 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-30d4dc5a-3804-4867-8d67-8cfab37dbafc tempest-VolumesImageMetadata-1915436809 None] Created volume successfully. Sep 01 08:26:09 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0473c2ca-ebb2-443b-af61-1c3eed050fe0 tempest-VolumesImageMetadata-1915436809 None] Acquiring lock "cinder-ba3d219f-0cd8-4448-aa99-9a8e7da5af2b-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:26:09 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0473c2ca-ebb2-443b-af61-1c3eed050fe0 tempest-VolumesImageMetadata-1915436809 None] Lock "cinder-ba3d219f-0cd8-4448-aa99-9a8e7da5af2b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:26:09 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0473c2ca-ebb2-443b-af61-1c3eed050fe0 tempest-VolumesImageMetadata-1915436809 None] Acquiring lock "cinder-quobyte-ba3d219f-0cd8-4448-aa99-9a8e7da5af2b" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:26:09 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0473c2ca-ebb2-443b-af61-1c3eed050fe0 tempest-VolumesImageMetadata-1915436809 None] Lock "cinder-quobyte-ba3d219f-0cd8-4448-aa99-9a8e7da5af2b" acquired by "delete_volume" :: waited 0.015s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:26:09 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[433a4ca3-a844-4cbb-af62-c9f269c972f0]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:26:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0473c2ca-ebb2-443b-af61-1c3eed050fe0 tempest-VolumesImageMetadata-1915436809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ba3d219f-0cd8-4448-aa99-9a8e7da5af2b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:09 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ba3d219f-0cd8-4448-aa99-9a8e7da5af2b Sep 01 08:26:09 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:09 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0473c2ca-ebb2-443b-af61-1c3eed050fe0 tempest-VolumesImageMetadata-1915436809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ba3d219f-0cd8-4448-aa99-9a8e7da5af2b" returned: 0 in 0.376s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0473c2ca-ebb2-443b-af61-1c3eed050fe0 tempest-VolumesImageMetadata-1915436809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ba3d219f-0cd8-4448-aa99-9a8e7da5af2b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:10 devstack sudo[100344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ba3d219f-0cd8-4448-aa99-9a8e7da5af2b Sep 01 08:26:10 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:10 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0473c2ca-ebb2-443b-af61-1c3eed050fe0 tempest-VolumesImageMetadata-1915436809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ba3d219f-0cd8-4448-aa99-9a8e7da5af2b" returned: 0 in 0.263s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:10 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0473c2ca-ebb2-443b-af61-1c3eed050fe0 tempest-VolumesImageMetadata-1915436809 None] Lock "cinder-quobyte-ba3d219f-0cd8-4448-aa99-9a8e7da5af2b" released by "delete_volume" :: held 0.688s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:26:10 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-0473c2ca-ebb2-443b-af61-1c3eed050fe0 tempest-VolumesImageMetadata-1915436809 None] Created reservations ['cab4b7c3-186e-4d02-b9f0-f02224ea5b9c', 'b874dfda-7ef1-4961-be07-baaa1557a5fc', '3fa2cdee-b050-4517-b0e5-efdfbe9249b1', '6c221201-1b60-4765-b0d5-e09500795c5e'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:26:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0473c2ca-ebb2-443b-af61-1c3eed050fe0 tempest-VolumesImageMetadata-1915436809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:26:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0473c2ca-ebb2-443b-af61-1c3eed050fe0 tempest-VolumesImageMetadata-1915436809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:26:10 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0473c2ca-ebb2-443b-af61-1c3eed050fe0 tempest-VolumesImageMetadata-1915436809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:26:10 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0473c2ca-ebb2-443b-af61-1c3eed050fe0 tempest-VolumesImageMetadata-1915436809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:26:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0473c2ca-ebb2-443b-af61-1c3eed050fe0 tempest-VolumesImageMetadata-1915436809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:26:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0473c2ca-ebb2-443b-af61-1c3eed050fe0 tempest-VolumesImageMetadata-1915436809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:10 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:26:10 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:10 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0473c2ca-ebb2-443b-af61-1c3eed050fe0 tempest-VolumesImageMetadata-1915436809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.297s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:10 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-0473c2ca-ebb2-443b-af61-1c3eed050fe0 tempest-VolumesImageMetadata-1915436809 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:26:10 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-0473c2ca-ebb2-443b-af61-1c3eed050fe0 tempest-VolumesImageMetadata-1915436809 None] Deleted volume successfully. Sep 01 08:26:10 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0473c2ca-ebb2-443b-af61-1c3eed050fe0 tempest-VolumesImageMetadata-1915436809 None] Lock "cinder-ba3d219f-0cd8-4448-aa99-9a8e7da5af2b-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:26:16 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b49bb86a-fd27-49fd-8cc2-d8c15c794566 tempest-VolumesActionsTest-1846254690 None] Acquiring lock "cinder-1cf5ef65-2af2-44c2-bb36-156373d4a02a" by "attach_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:26:16 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b49bb86a-fd27-49fd-8cc2-d8c15c794566 tempest-VolumesActionsTest-1846254690 None] Lock "cinder-1cf5ef65-2af2-44c2-bb36-156373d4a02a" acquired by "attach_volume" :: waited 0.027s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:26:16 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=123,cinder:UPDATE=163,cinder:DELETE=11,cinder:INSERT=44 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:26:16 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=138,cinder:UPDATE=150,cinder:INSERT=47,cinder:DELETE=16 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:26:17 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-b49bb86a-fd27-49fd-8cc2-d8c15c794566 tempest-VolumesActionsTest-1846254690 None] Attaching volume 1cf5ef65-2af2-44c2-bb36-156373d4a02a to instance 8206c9ab-9627-4bd4-8f53-faa06336814d at mountpoint /dev/vdb on host None. Sep 01 08:26:17 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-b49bb86a-fd27-49fd-8cc2-d8c15c794566 tempest-VolumesActionsTest-1846254690 None] Attach volume completed successfully. Sep 01 08:26:17 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b49bb86a-fd27-49fd-8cc2-d8c15c794566 tempest-VolumesActionsTest-1846254690 None] Lock "cinder-1cf5ef65-2af2-44c2-bb36-156373d4a02a" released by "attach_volume" :: held 0.128s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:26:17 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-19b4e934-ed5f-4b4e-a819-f0ba4ade1081 tempest-VolumesActionsTest-1846254690 None] Acquiring lock "cinder-1cf5ef65-2af2-44c2-bb36-156373d4a02a-detach_volume" by "detach_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:26:17 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-19b4e934-ed5f-4b4e-a819-f0ba4ade1081 tempest-VolumesActionsTest-1846254690 None] Lock "cinder-1cf5ef65-2af2-44c2-bb36-156373d4a02a-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:26:17 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-19b4e934-ed5f-4b4e-a819-f0ba4ade1081 tempest-VolumesActionsTest-1846254690 None] Detaching volume 1cf5ef65-2af2-44c2-bb36-156373d4a02a from instance 8206c9ab-9627-4bd4-8f53-faa06336814d. Sep 01 08:26:17 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-19b4e934-ed5f-4b4e-a819-f0ba4ade1081 tempest-VolumesActionsTest-1846254690 None] Detach volume completed successfully. Sep 01 08:26:17 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-19b4e934-ed5f-4b4e-a819-f0ba4ade1081 tempest-VolumesActionsTest-1846254690 None] Lock "cinder-1cf5ef65-2af2-44c2-bb36-156373d4a02a-detach_volume" released by "detach_volume" :: held 0.080s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:26:18 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:26:18 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] Flow 'volume_create_manager' (e954cf74-a2c7-4341-b48b-290d442c11f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:26:18 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d8d9ee-f46c-4d69-b374-eed567ce7b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:26:18 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d8d9ee-f46c-4d69-b374-eed567ce7b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-391271898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a10a76bf-b2fa-43e6-88e6-8d064427f325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34a4c4c2cae489b917a6a9264cef8d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:26:18Z,use_quota=True,user_id='5e5e6a12da1847d2b5e0d8baace64630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:26:18 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d277164-6c12-4401-ae70-4ae050aba1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:26:18 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d277164-6c12-4401-ae70-4ae050aba1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:26:18 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e5d00d3-3819-4931-9755-634b6442baf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:26:18 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e5d00d3-3819-4931-9755-634b6442baf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a10a76bf-b2fa-43e6-88e6-8d064427f325', 'volume_name': 'volume-a10a76bf-b2fa-43e6-88e6-8d064427f325', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:26:18 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa62db1-8bd4-4117-9096-d21b70da7166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:26:18 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa62db1-8bd4-4117-9096-d21b70da7166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:26:18 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fbf793d-5cc7-49b9-a576-84dcf4c44c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:26:18 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] Volume a10a76bf-b2fa-43e6-88e6-8d064427f325: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a10a76bf-b2fa-43e6-88e6-8d064427f325', 'volume_size': 1} Sep 01 08:26:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:26:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:26:18 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-391271898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a10a76bf-b2fa-43e6-88e6-8d064427f325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34a4c4c2cae489b917a6a9264cef8d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:26:18Z,use_quota=True,user_id='5e5e6a12da1847d2b5e0d8baace64630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:26:18 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] Creating volume a10a76bf-b2fa-43e6-88e6-8d064427f325 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:26:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:26:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:26:18 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:26:18 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:26:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:26:18 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:26:18 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:26:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a10a76bf-b2fa-43e6-88e6-8d064427f325 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:18 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a10a76bf-b2fa-43e6-88e6-8d064427f325 1073741824 Sep 01 08:26:18 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:19 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a10a76bf-b2fa-43e6-88e6-8d064427f325 1073741824" returned: 0 in 0.542s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a10a76bf-b2fa-43e6-88e6-8d064427f325 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:19 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a10a76bf-b2fa-43e6-88e6-8d064427f325 Sep 01 08:26:19 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:19 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a10a76bf-b2fa-43e6-88e6-8d064427f325" returned: 0 in 0.259s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:19 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:26:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:26:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fbf793d-5cc7-49b9-a576-84dcf4c44c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a10a76bf-b2fa-43e6-88e6-8d064427f325', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:26:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e196c46f-bc1a-4849-b357-54a458b13508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:26:19 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] Volume volume-a10a76bf-b2fa-43e6-88e6-8d064427f325 (a10a76bf-b2fa-43e6-88e6-8d064427f325): created successfully Sep 01 08:26:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e196c46f-bc1a-4849-b357-54a458b13508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:26:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] Flow 'volume_create_manager' (e954cf74-a2c7-4341-b48b-290d442c11f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:26:19 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-0433bed5-ee22-4f5b-803f-9f5c6c211c6b tempest-AbsoluteLimitsTests-1833517650 None] Created volume successfully. Sep 01 08:26:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1e76142d-0db9-4900-a6ed-00ab760eb84d tempest-AbsoluteLimitsTests-1833517650 None] Acquiring lock "cinder-a10a76bf-b2fa-43e6-88e6-8d064427f325-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:26:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1e76142d-0db9-4900-a6ed-00ab760eb84d tempest-AbsoluteLimitsTests-1833517650 None] Lock "cinder-a10a76bf-b2fa-43e6-88e6-8d064427f325-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:26:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1e76142d-0db9-4900-a6ed-00ab760eb84d tempest-AbsoluteLimitsTests-1833517650 None] Acquiring lock "cinder-quobyte-a10a76bf-b2fa-43e6-88e6-8d064427f325" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:26:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1e76142d-0db9-4900-a6ed-00ab760eb84d tempest-AbsoluteLimitsTests-1833517650 None] Lock "cinder-quobyte-a10a76bf-b2fa-43e6-88e6-8d064427f325" acquired by "delete_volume" :: waited 0.013s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:26:20 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[217a6ac5-36ca-4277-a28c-795725d6fd6a]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:26:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1e76142d-0db9-4900-a6ed-00ab760eb84d tempest-AbsoluteLimitsTests-1833517650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a10a76bf-b2fa-43e6-88e6-8d064427f325 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:20 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a10a76bf-b2fa-43e6-88e6-8d064427f325 Sep 01 08:26:20 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:21 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1e76142d-0db9-4900-a6ed-00ab760eb84d tempest-AbsoluteLimitsTests-1833517650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a10a76bf-b2fa-43e6-88e6-8d064427f325" returned: 0 in 0.389s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1e76142d-0db9-4900-a6ed-00ab760eb84d tempest-AbsoluteLimitsTests-1833517650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a10a76bf-b2fa-43e6-88e6-8d064427f325 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:21 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a10a76bf-b2fa-43e6-88e6-8d064427f325 Sep 01 08:26:21 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:21 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1e76142d-0db9-4900-a6ed-00ab760eb84d tempest-AbsoluteLimitsTests-1833517650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a10a76bf-b2fa-43e6-88e6-8d064427f325" returned: 0 in 0.261s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:21 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1e76142d-0db9-4900-a6ed-00ab760eb84d tempest-AbsoluteLimitsTests-1833517650 None] Lock "cinder-quobyte-a10a76bf-b2fa-43e6-88e6-8d064427f325" released by "delete_volume" :: held 0.695s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:26:21 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-1e76142d-0db9-4900-a6ed-00ab760eb84d tempest-AbsoluteLimitsTests-1833517650 None] Created reservations ['0807d47d-cf07-4009-be27-5e858b85a7c8', 'da9aca9c-28f4-4c78-9e84-91d3578a92bb', '35f03475-f674-479d-b34e-d390cfd89904', 'cbad0635-29e9-4bae-be84-4a12c619c528'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:26:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1e76142d-0db9-4900-a6ed-00ab760eb84d tempest-AbsoluteLimitsTests-1833517650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:26:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1e76142d-0db9-4900-a6ed-00ab760eb84d tempest-AbsoluteLimitsTests-1833517650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:26:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1e76142d-0db9-4900-a6ed-00ab760eb84d tempest-AbsoluteLimitsTests-1833517650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:26:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1e76142d-0db9-4900-a6ed-00ab760eb84d tempest-AbsoluteLimitsTests-1833517650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:26:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1e76142d-0db9-4900-a6ed-00ab760eb84d tempest-AbsoluteLimitsTests-1833517650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:26:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1e76142d-0db9-4900-a6ed-00ab760eb84d tempest-AbsoluteLimitsTests-1833517650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:21 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:26:21 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:21 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1e76142d-0db9-4900-a6ed-00ab760eb84d tempest-AbsoluteLimitsTests-1833517650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.255s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:21 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-1e76142d-0db9-4900-a6ed-00ab760eb84d tempest-AbsoluteLimitsTests-1833517650 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:26:21 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-1e76142d-0db9-4900-a6ed-00ab760eb84d tempest-AbsoluteLimitsTests-1833517650 None] Deleted volume successfully. Sep 01 08:26:21 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1e76142d-0db9-4900-a6ed-00ab760eb84d tempest-AbsoluteLimitsTests-1833517650 None] Lock "cinder-a10a76bf-b2fa-43e6-88e6-8d064427f325-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:26:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7da83d64-15ca-43fe-8387-1766f23b135b tempest-VolumesActionsTest-1846254690 None] Acquiring lock "cinder-1cf5ef65-2af2-44c2-bb36-156373d4a02a" by "attach_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:26:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7da83d64-15ca-43fe-8387-1766f23b135b tempest-VolumesActionsTest-1846254690 None] Lock "cinder-1cf5ef65-2af2-44c2-bb36-156373d4a02a" acquired by "attach_volume" :: waited 0.027s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:26:28 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-7da83d64-15ca-43fe-8387-1766f23b135b tempest-VolumesActionsTest-1846254690 None] Attaching volume 1cf5ef65-2af2-44c2-bb36-156373d4a02a to instance f79adf68-8ada-4f41-a75d-3eba340ea260 at mountpoint /dev/vdb on host None. Sep 01 08:26:28 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-7da83d64-15ca-43fe-8387-1766f23b135b tempest-VolumesActionsTest-1846254690 None] Attach volume completed successfully. Sep 01 08:26:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7da83d64-15ca-43fe-8387-1766f23b135b tempest-VolumesActionsTest-1846254690 None] Lock "cinder-1cf5ef65-2af2-44c2-bb36-156373d4a02a" released by "attach_volume" :: held 0.162s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:26:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-34b55f1a-d563-41e3-8aea-0f81eb024842 tempest-VolumesActionsTest-1846254690 None] Acquiring lock "cinder-1cf5ef65-2af2-44c2-bb36-156373d4a02a-detach_volume" by "detach_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:26:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-34b55f1a-d563-41e3-8aea-0f81eb024842 tempest-VolumesActionsTest-1846254690 None] Lock "cinder-1cf5ef65-2af2-44c2-bb36-156373d4a02a-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:26:28 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-34b55f1a-d563-41e3-8aea-0f81eb024842 tempest-VolumesActionsTest-1846254690 None] Detaching volume 1cf5ef65-2af2-44c2-bb36-156373d4a02a from instance f79adf68-8ada-4f41-a75d-3eba340ea260. Sep 01 08:26:28 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-34b55f1a-d563-41e3-8aea-0f81eb024842 tempest-VolumesActionsTest-1846254690 None] Detach volume completed successfully. Sep 01 08:26:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-34b55f1a-d563-41e3-8aea-0f81eb024842 tempest-VolumesActionsTest-1846254690 None] Lock "cinder-1cf5ef65-2af2-44c2-bb36-156373d4a02a-detach_volume" released by "detach_volume" :: held 0.105s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:26:29 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:26:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] Flow 'volume_create_manager' (90aae1cd-fdde-428c-8bc1-fc7cb451c3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:26:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc62a9df-23b5-4609-9235-691dfc4bfb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:26:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc62a9df-23b5-4609-9235-691dfc4bfb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-463562895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d60386d-9159-406d-b09d-1f81d0d82c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b7aacab5a644a5fbb9e0675103daf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:26:29Z,use_quota=True,user_id='84375293681440b880c87102c0781ee0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:26:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a81ca8d-f788-4b34-8f71-1b15c31584b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:26:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a81ca8d-f788-4b34-8f71-1b15c31584b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:26:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88eda917-5774-4f58-9f6b-cfb1c814ed50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:26:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88eda917-5774-4f58-9f6b-cfb1c814ed50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d60386d-9159-406d-b09d-1f81d0d82c39', 'volume_name': 'volume-7d60386d-9159-406d-b09d-1f81d0d82c39', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:26:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (747dcd67-9502-4429-aa64-8e09d089cb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:26:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (747dcd67-9502-4429-aa64-8e09d089cb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:26:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd1e33b2-9e15-42c2-a498-675e31af3704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:26:29 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] Volume 7d60386d-9159-406d-b09d-1f81d0d82c39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d60386d-9159-406d-b09d-1f81d0d82c39', 'volume_size': 1} Sep 01 08:26:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:26:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:26:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-463562895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d60386d-9159-406d-b09d-1f81d0d82c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b7aacab5a644a5fbb9e0675103daf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:26:29Z,use_quota=True,user_id='84375293681440b880c87102c0781ee0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:26:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] Creating volume 7d60386d-9159-406d-b09d-1f81d0d82c39 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:26:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:26:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:26:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:26:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:26:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:26:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:26:29 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:26:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7d60386d-9159-406d-b09d-1f81d0d82c39 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:29 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7d60386d-9159-406d-b09d-1f81d0d82c39 1073741824 Sep 01 08:26:29 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:29 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7d60386d-9159-406d-b09d-1f81d0d82c39 1073741824" returned: 0 in 0.576s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7d60386d-9159-406d-b09d-1f81d0d82c39 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:29 devstack sudo[100610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7d60386d-9159-406d-b09d-1f81d0d82c39 Sep 01 08:26:29 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:30 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7d60386d-9159-406d-b09d-1f81d0d82c39" returned: 0 in 0.253s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:26:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:26:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd1e33b2-9e15-42c2-a498-675e31af3704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d60386d-9159-406d-b09d-1f81d0d82c39', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:26:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3bd0627-8e5d-40af-8a0c-6c728cdb4069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:26:30 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] Volume volume-7d60386d-9159-406d-b09d-1f81d0d82c39 (7d60386d-9159-406d-b09d-1f81d0d82c39): created successfully Sep 01 08:26:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3bd0627-8e5d-40af-8a0c-6c728cdb4069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:26:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] Flow 'volume_create_manager' (90aae1cd-fdde-428c-8bc1-fc7cb451c3c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:26:30 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-fbac2761-4502-4fae-bbfe-a789da830c8b tempest-VolumesTransfersTest-1471603436 None] Created volume successfully. Sep 01 08:26:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:26:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:26:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:26:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:26:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:26:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:26:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:31 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:26:31 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:31 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.279s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:31 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:26:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager._thread_info {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:26:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread count: 28 {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 08:26:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread info: [<_MainThread(MainThread, started 138934582050944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 08:26:31 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-21bb8883-23f1-4d94-90d6-b516a258fa77 tempest-VolumesTransfersTest-1897609830 None] Transfer volume completed successfully. Sep 01 08:26:32 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-78f5c383-379a-4f64-9885-c43ea32aaa23 tempest-VolumesTransfersTest-1857608393 None] Acquiring lock "cinder-7d60386d-9159-406d-b09d-1f81d0d82c39-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:26:32 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-78f5c383-379a-4f64-9885-c43ea32aaa23 tempest-VolumesTransfersTest-1857608393 None] Lock "cinder-7d60386d-9159-406d-b09d-1f81d0d82c39-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:26:32 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-78f5c383-379a-4f64-9885-c43ea32aaa23 tempest-VolumesTransfersTest-1857608393 None] Acquiring lock "cinder-quobyte-7d60386d-9159-406d-b09d-1f81d0d82c39" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:26:32 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-78f5c383-379a-4f64-9885-c43ea32aaa23 tempest-VolumesTransfersTest-1857608393 None] Lock "cinder-quobyte-7d60386d-9159-406d-b09d-1f81d0d82c39" acquired by "delete_volume" :: waited 0.018s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:26:32 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[712a5b3d-ba43-4e1a-91db-9361fcf9a407]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:26:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-78f5c383-379a-4f64-9885-c43ea32aaa23 tempest-VolumesTransfersTest-1857608393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7d60386d-9159-406d-b09d-1f81d0d82c39 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:32 devstack sudo[100618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7d60386d-9159-406d-b09d-1f81d0d82c39 Sep 01 08:26:32 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:32 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-78f5c383-379a-4f64-9885-c43ea32aaa23 tempest-VolumesTransfersTest-1857608393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7d60386d-9159-406d-b09d-1f81d0d82c39" returned: 0 in 0.370s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-78f5c383-379a-4f64-9885-c43ea32aaa23 tempest-VolumesTransfersTest-1857608393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7d60386d-9159-406d-b09d-1f81d0d82c39 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:32 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7d60386d-9159-406d-b09d-1f81d0d82c39 Sep 01 08:26:32 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:32 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-78f5c383-379a-4f64-9885-c43ea32aaa23 tempest-VolumesTransfersTest-1857608393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7d60386d-9159-406d-b09d-1f81d0d82c39" returned: 0 in 0.258s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:32 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-78f5c383-379a-4f64-9885-c43ea32aaa23 tempest-VolumesTransfersTest-1857608393 None] Lock "cinder-quobyte-7d60386d-9159-406d-b09d-1f81d0d82c39" released by "delete_volume" :: held 0.673s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:26:33 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-78f5c383-379a-4f64-9885-c43ea32aaa23 tempest-VolumesTransfersTest-1857608393 None] Created reservations ['bb542258-a029-4d58-ae9a-3d562e011c99', '945001ea-1e2e-4ddc-beef-53888424643b', 'b8ded947-dc31-42c7-9bec-1a2d164e4a61', 'e52522c2-92e8-40f6-a70b-af75f89fb4f4'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:26:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-78f5c383-379a-4f64-9885-c43ea32aaa23 tempest-VolumesTransfersTest-1857608393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:26:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-78f5c383-379a-4f64-9885-c43ea32aaa23 tempest-VolumesTransfersTest-1857608393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:26:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-78f5c383-379a-4f64-9885-c43ea32aaa23 tempest-VolumesTransfersTest-1857608393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:26:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-78f5c383-379a-4f64-9885-c43ea32aaa23 tempest-VolumesTransfersTest-1857608393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:26:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-78f5c383-379a-4f64-9885-c43ea32aaa23 tempest-VolumesTransfersTest-1857608393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:26:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-78f5c383-379a-4f64-9885-c43ea32aaa23 tempest-VolumesTransfersTest-1857608393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:33 devstack sudo[100627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:26:33 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8d3903d4-8b55-4273-968c-1e91b4671f28 tempest-VolumesActionsTest-1846254690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:26:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8d3903d4-8b55-4273-968c-1e91b4671f28 tempest-VolumesActionsTest-1846254690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:26:33 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3b33dc-68d8-4f4a-a627-7d3f5b564113]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:26:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8d3903d4-8b55-4273-968c-1e91b4671f28 tempest-VolumesActionsTest-1846254690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:33 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-78f5c383-379a-4f64-9885-c43ea32aaa23 tempest-VolumesTransfersTest-1857608393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.262s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:33 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-78f5c383-379a-4f64-9885-c43ea32aaa23 tempest-VolumesTransfersTest-1857608393 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:26:33 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-78f5c383-379a-4f64-9885-c43ea32aaa23 tempest-VolumesTransfersTest-1857608393 None] Deleted volume successfully. Sep 01 08:26:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-78f5c383-379a-4f64-9885-c43ea32aaa23 tempest-VolumesTransfersTest-1857608393 None] Lock "cinder-7d60386d-9159-406d-b09d-1f81d0d82c39-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:26:33 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a Sep 01 08:26:33 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:33 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8d3903d4-8b55-4273-968c-1e91b4671f28 tempest-VolumesActionsTest-1846254690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a" returned: 0 in 0.392s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:33 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[87abe24e-e034-4a90-98b1-04c1f8313828]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:26:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8d3903d4-8b55-4273-968c-1e91b4671f28 tempest-VolumesActionsTest-1846254690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:33 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a Sep 01 08:26:33 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:33 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:26:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] Flow 'volume_create_manager' (da6c8718-a46a-4cbc-b437-7ccba8bce420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:26:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75361103-0078-4d1e-9927-bb25d5b73b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:26:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75361103-0078-4d1e-9927-bb25d5b73b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-95080604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234fcb8d-76ca-4814-b45d-84225d0700fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b7aacab5a644a5fbb9e0675103daf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:26:34Z,use_quota=True,user_id='84375293681440b880c87102c0781ee0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:26:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60fcbed2-7366-4da1-ad4b-fc5ae7cdf30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:26:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60fcbed2-7366-4da1-ad4b-fc5ae7cdf30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:26:33 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b20093-64c0-42e6-8ee4-c136e18dc150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:26:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b20093-64c0-42e6-8ee4-c136e18dc150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '234fcb8d-76ca-4814-b45d-84225d0700fa', 'volume_name': 'volume-234fcb8d-76ca-4814-b45d-84225d0700fa', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:26:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b285c40b-95a2-42e8-a347-59f75e8ac7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:26:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b285c40b-95a2-42e8-a347-59f75e8ac7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:26:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c631d29-4c67-4053-ad99-dee9042bc6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:26:34 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] Volume 234fcb8d-76ca-4814-b45d-84225d0700fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-234fcb8d-76ca-4814-b45d-84225d0700fa', 'volume_size': 1} Sep 01 08:26:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:26:34 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8d3903d4-8b55-4273-968c-1e91b4671f28 tempest-VolumesActionsTest-1846254690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a" returned: 0 in 0.366s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8d3903d4-8b55-4273-968c-1e91b4671f28 tempest-VolumesActionsTest-1846254690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a /opt/stack/data/cinder/conversion/1cf5ef65-2af2-44c2-bb36-156373d4a02a.temp_image.deb2fea5-6c1b-4577-9467-844f0d80539a_fj69vyc.img {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:34 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a /opt/stack/data/cinder/conversion/1cf5ef65-2af2-44c2-bb36-156373d4a02a.temp_image.deb2fea5-6c1b-4577-9467-844f0d80539a_fj69vyc.img Sep 01 08:26:34 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:38 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8d3903d4-8b55-4273-968c-1e91b4671f28 tempest-VolumesActionsTest-1846254690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a /opt/stack/data/cinder/conversion/1cf5ef65-2af2-44c2-bb36-156373d4a02a.temp_image.deb2fea5-6c1b-4577-9467-844f0d80539a_fj69vyc.img" returned: 0 in 4.006s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:38 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d83fbb-f31f-4862-8532-86982098a96e]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:26:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8d3903d4-8b55-4273-968c-1e91b4671f28 tempest-VolumesActionsTest-1846254690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:38 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a Sep 01 08:26:38 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:38 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8d3903d4-8b55-4273-968c-1e91b4671f28 tempest-VolumesActionsTest-1846254690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a" returned: 0 in 0.541s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:38 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-8d3903d4-8b55-4273-968c-1e91b4671f28 tempest-VolumesActionsTest-1846254690 None] Image conversion details: src /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a, size 1024.00 MB, duration 4.01 sec, destination /opt/stack/data/cinder/conversion/1cf5ef65-2af2-44c2-bb36-156373d4a02a.temp_image.deb2fea5-6c1b-4577-9467-844f0d80539a_fj69vyc.img {{(pid=86893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 08:26:38 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-8d3903d4-8b55-4273-968c-1e91b4671f28 tempest-VolumesActionsTest-1846254690 None] Converted 1024.00 MB image at 255.52 MB/s Sep 01 08:26:38 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-8d3903d4-8b55-4273-968c-1e91b4671f28 tempest-VolumesActionsTest-1846254690 None] deb2fea5-6c1b-4577-9467-844f0d80539a was raw, no need to convert to raw {{(pid=86893) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 01 08:26:43 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=32,cinder:UPDATE=28,cinder:INSERT=7,cinder:DELETE=2 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:26:48 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:UPDATE=30,cinder:SELECT=28,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:26:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8d3903d4-8b55-4273-968c-1e91b4671f28 tempest-VolumesActionsTest-1846254690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 23.070s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:26:56 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8d3903d4-8b55-4273-968c-1e91b4671f28 tempest-VolumesActionsTest-1846254690 None] Uploaded volume to glance image-id: deb2fea5-6c1b-4577-9467-844f0d80539a. {{(pid=86893) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 08:26:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.331s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:26:56 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-95080604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234fcb8d-76ca-4814-b45d-84225d0700fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b7aacab5a644a5fbb9e0675103daf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:26:34Z,use_quota=True,user_id='84375293681440b880c87102c0781ee0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:26:56 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] Creating volume 234fcb8d-76ca-4814-b45d-84225d0700fa {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:26:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:26:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:26:56 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:26:56 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:26:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:26:56 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:26:56 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:26:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-234fcb8d-76ca-4814-b45d-84225d0700fa 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:56 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-8d3903d4-8b55-4273-968c-1e91b4671f28 tempest-VolumesActionsTest-1846254690 None] Copy volume to image completed successfully. Sep 01 08:26:56 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-234fcb8d-76ca-4814-b45d-84225d0700fa 1073741824 Sep 01 08:26:56 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:56 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-234fcb8d-76ca-4814-b45d-84225d0700fa 1073741824" returned: 0 in 0.423s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-234fcb8d-76ca-4814-b45d-84225d0700fa {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:56 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-234fcb8d-76ca-4814-b45d-84225d0700fa Sep 01 08:26:56 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:57 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-234fcb8d-76ca-4814-b45d-84225d0700fa" returned: 0 in 0.244s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:26:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:26:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c631d29-4c67-4053-ad99-dee9042bc6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-234fcb8d-76ca-4814-b45d-84225d0700fa', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:26:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64572b6f-a122-4561-861c-fc9e2def9103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:26:57 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] Volume volume-234fcb8d-76ca-4814-b45d-84225d0700fa (234fcb8d-76ca-4814-b45d-84225d0700fa): created successfully Sep 01 08:26:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64572b6f-a122-4561-861c-fc9e2def9103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:26:57 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] Flow 'volume_create_manager' (da6c8718-a46a-4cbc-b437-7ccba8bce420) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:26:57 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-351162d8-548d-4d99-8fda-c63ed8ed08d2 tempest-VolumesTransfersTest-1471603436 None] Created volume successfully. Sep 01 08:26:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-aa31fa92-13c7-484c-abc0-6c968694824f tempest-VolumesTransfersTest-1857608393 None] Acquiring lock "cinder-234fcb8d-76ca-4814-b45d-84225d0700fa-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:26:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-aa31fa92-13c7-484c-abc0-6c968694824f tempest-VolumesTransfersTest-1857608393 None] Lock "cinder-234fcb8d-76ca-4814-b45d-84225d0700fa-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:26:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-aa31fa92-13c7-484c-abc0-6c968694824f tempest-VolumesTransfersTest-1857608393 None] Acquiring lock "cinder-quobyte-234fcb8d-76ca-4814-b45d-84225d0700fa" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:26:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-aa31fa92-13c7-484c-abc0-6c968694824f tempest-VolumesTransfersTest-1857608393 None] Lock "cinder-quobyte-234fcb8d-76ca-4814-b45d-84225d0700fa" acquired by "delete_volume" :: waited 0.022s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:26:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0c21c925-e68e-4ff0-a3ba-b44a2717582b tempest-VolumesActionsTest-1846254690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:26:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0c21c925-e68e-4ff0-a3ba-b44a2717582b tempest-VolumesActionsTest-1846254690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:26:57 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77c3c53-5c4f-4040-938e-0815392017e4]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:26:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-aa31fa92-13c7-484c-abc0-6c968694824f tempest-VolumesTransfersTest-1857608393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-234fcb8d-76ca-4814-b45d-84225d0700fa {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:57 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83e8e6c-0b62-4058-8975-d3e7ff61344d]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:26:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0c21c925-e68e-4ff0-a3ba-b44a2717582b tempest-VolumesActionsTest-1846254690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:58 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-234fcb8d-76ca-4814-b45d-84225d0700fa Sep 01 08:26:58 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:58 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a Sep 01 08:26:58 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:58 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:58 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-aa31fa92-13c7-484c-abc0-6c968694824f tempest-VolumesTransfersTest-1857608393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-234fcb8d-76ca-4814-b45d-84225d0700fa" returned: 0 in 0.370s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-aa31fa92-13c7-484c-abc0-6c968694824f tempest-VolumesTransfersTest-1857608393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-234fcb8d-76ca-4814-b45d-84225d0700fa {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0c21c925-e68e-4ff0-a3ba-b44a2717582b tempest-VolumesActionsTest-1846254690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a" returned: 0 in 0.368s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:58 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1dd685-c829-4260-bd0c-00353037a7c7]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:26:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0c21c925-e68e-4ff0-a3ba-b44a2717582b tempest-VolumesActionsTest-1846254690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:58 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-234fcb8d-76ca-4814-b45d-84225d0700fa Sep 01 08:26:58 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:58 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a Sep 01 08:26:58 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:58 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-aa31fa92-13c7-484c-abc0-6c968694824f tempest-VolumesTransfersTest-1857608393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-234fcb8d-76ca-4814-b45d-84225d0700fa" returned: 0 in 0.256s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:58 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-aa31fa92-13c7-484c-abc0-6c968694824f tempest-VolumesTransfersTest-1857608393 None] Lock "cinder-quobyte-234fcb8d-76ca-4814-b45d-84225d0700fa" released by "delete_volume" :: held 0.677s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:26:58 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-aa31fa92-13c7-484c-abc0-6c968694824f tempest-VolumesTransfersTest-1857608393 None] Created reservations ['8ab01792-ca4f-4747-b738-109acc3343a2', 'c3deedb8-abfd-447e-9a21-3ac1e3eda27f', '18c45b2d-b84f-4e22-acf7-fe4c2c19e20d', 'cbfe445b-0bf2-4a2f-8980-290755e491ea'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:26:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-aa31fa92-13c7-484c-abc0-6c968694824f tempest-VolumesTransfersTest-1857608393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:26:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-aa31fa92-13c7-484c-abc0-6c968694824f tempest-VolumesTransfersTest-1857608393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:26:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-aa31fa92-13c7-484c-abc0-6c968694824f tempest-VolumesTransfersTest-1857608393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:26:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-aa31fa92-13c7-484c-abc0-6c968694824f tempest-VolumesTransfersTest-1857608393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:26:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-aa31fa92-13c7-484c-abc0-6c968694824f tempest-VolumesTransfersTest-1857608393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:26:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-aa31fa92-13c7-484c-abc0-6c968694824f tempest-VolumesTransfersTest-1857608393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:58 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:58 devstack sudo[100690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:26:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0c21c925-e68e-4ff0-a3ba-b44a2717582b tempest-VolumesActionsTest-1846254690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a" returned: 0 in 0.380s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:58 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0c21c925-e68e-4ff0-a3ba-b44a2717582b tempest-VolumesActionsTest-1846254690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a /opt/stack/data/cinder/conversion/1cf5ef65-2af2-44c2-bb36-156373d4a02a.temp_image.23e80caa-6747-42e2-8307-96ca2eaf87bew0wqm_yc.img {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:26:58 devstack sudo[100692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a /opt/stack/data/cinder/conversion/1cf5ef65-2af2-44c2-bb36-156373d4a02a.temp_image.23e80caa-6747-42e2-8307-96ca2eaf87bew0wqm_yc.img Sep 01 08:26:58 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:26:58 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root Sep 01 08:26:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-aa31fa92-13c7-484c-abc0-6c968694824f tempest-VolumesTransfersTest-1857608393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.255s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:26:58 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-aa31fa92-13c7-484c-abc0-6c968694824f tempest-VolumesTransfersTest-1857608393 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:26:58 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-aa31fa92-13c7-484c-abc0-6c968694824f tempest-VolumesTransfersTest-1857608393 None] Deleted volume successfully. Sep 01 08:26:58 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-aa31fa92-13c7-484c-abc0-6c968694824f tempest-VolumesTransfersTest-1857608393 None] Lock "cinder-234fcb8d-76ca-4814-b45d-84225d0700fa-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:27:03 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0c21c925-e68e-4ff0-a3ba-b44a2717582b tempest-VolumesActionsTest-1846254690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a /opt/stack/data/cinder/conversion/1cf5ef65-2af2-44c2-bb36-156373d4a02a.temp_image.23e80caa-6747-42e2-8307-96ca2eaf87bew0wqm_yc.img" returned: 0 in 4.731s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:03 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[d116898b-5988-435b-abf8-f02ae059b09f]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:27:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0c21c925-e68e-4ff0-a3ba-b44a2717582b tempest-VolumesActionsTest-1846254690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:03 devstack sudo[100707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a Sep 01 08:27:03 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:04 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0c21c925-e68e-4ff0-a3ba-b44a2717582b tempest-VolumesActionsTest-1846254690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a" returned: 0 in 0.553s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:04 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-0c21c925-e68e-4ff0-a3ba-b44a2717582b tempest-VolumesActionsTest-1846254690 None] Image conversion details: src /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a, size 1024.00 MB, duration 4.73 sec, destination /opt/stack/data/cinder/conversion/1cf5ef65-2af2-44c2-bb36-156373d4a02a.temp_image.23e80caa-6747-42e2-8307-96ca2eaf87bew0wqm_yc.img {{(pid=86893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 08:27:04 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-0c21c925-e68e-4ff0-a3ba-b44a2717582b tempest-VolumesActionsTest-1846254690 None] Converted 1024.00 MB image at 216.37 MB/s Sep 01 08:27:04 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-0c21c925-e68e-4ff0-a3ba-b44a2717582b tempest-VolumesActionsTest-1846254690 None] 23e80caa-6747-42e2-8307-96ca2eaf87be was raw, converting to qcow2 {{(pid=86893) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 01 08:27:04 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d052a8-eb7f-4f5a-b471-00cc1511db8f]: (4, 'raw') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:27:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0c21c925-e68e-4ff0-a3ba-b44a2717582b tempest-VolumesActionsTest-1846254690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1cf5ef65-2af2-44c2-bb36-156373d4a02a.temp_image.23e80caa-6747-42e2-8307-96ca2eaf87bew0wqm_yc.img {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:04 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1cf5ef65-2af2-44c2-bb36-156373d4a02a.temp_image.23e80caa-6747-42e2-8307-96ca2eaf87bew0wqm_yc.img Sep 01 08:27:04 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:04 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0c21c925-e68e-4ff0-a3ba-b44a2717582b tempest-VolumesActionsTest-1846254690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1cf5ef65-2af2-44c2-bb36-156373d4a02a.temp_image.23e80caa-6747-42e2-8307-96ca2eaf87bew0wqm_yc.img" returned: 0 in 0.340s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0c21c925-e68e-4ff0-a3ba-b44a2717582b tempest-VolumesActionsTest-1846254690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1cf5ef65-2af2-44c2-bb36-156373d4a02a.temp_image.23e80caa-6747-42e2-8307-96ca2eaf87bew0wqm_yc.img {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:04 devstack sudo[100716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1cf5ef65-2af2-44c2-bb36-156373d4a02a.temp_image.23e80caa-6747-42e2-8307-96ca2eaf87bew0wqm_yc.img Sep 01 08:27:04 devstack sudo[100716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:04 devstack sudo[100716]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0c21c925-e68e-4ff0-a3ba-b44a2717582b tempest-VolumesActionsTest-1846254690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1cf5ef65-2af2-44c2-bb36-156373d4a02a.temp_image.23e80caa-6747-42e2-8307-96ca2eaf87bew0wqm_yc.img" returned: 1 in 0.341s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0c21c925-e68e-4ff0-a3ba-b44a2717582b tempest-VolumesActionsTest-1846254690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1cf5ef65-2af2-44c2-bb36-156373d4a02a.temp_image.23e80caa-6747-42e2-8307-96ca2eaf87bew0wqm_yc.img' failed. Not Retrying. {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 08:27:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0c21c925-e68e-4ff0-a3ba-b44a2717582b tempest-VolumesActionsTest-1846254690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1cf5ef65-2af2-44c2-bb36-156373d4a02a.temp_image.23e80caa-6747-42e2-8307-96ca2eaf87bew0wqm_yc.img /opt/stack/data/cinder/conversion/vol_upload_z3n7g2ax {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:04 devstack sudo[100721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1cf5ef65-2af2-44c2-bb36-156373d4a02a.temp_image.23e80caa-6747-42e2-8307-96ca2eaf87bew0wqm_yc.img /opt/stack/data/cinder/conversion/vol_upload_z3n7g2ax Sep 01 08:27:04 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:05 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0c21c925-e68e-4ff0-a3ba-b44a2717582b tempest-VolumesActionsTest-1846254690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1cf5ef65-2af2-44c2-bb36-156373d4a02a.temp_image.23e80caa-6747-42e2-8307-96ca2eaf87bew0wqm_yc.img /opt/stack/data/cinder/conversion/vol_upload_z3n7g2ax" returned: 0 in 0.283s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:05 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-0c21c925-e68e-4ff0-a3ba-b44a2717582b tempest-VolumesActionsTest-1846254690 None] Image conversion details: src /opt/stack/data/cinder/conversion/1cf5ef65-2af2-44c2-bb36-156373d4a02a.temp_image.23e80caa-6747-42e2-8307-96ca2eaf87bew0wqm_yc.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_z3n7g2ax {{(pid=86893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 08:27:05 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-0c21c925-e68e-4ff0-a3ba-b44a2717582b tempest-VolumesActionsTest-1846254690 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 01 08:27:05 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[362afca4-8089-4fd9-8999-027b4e8ec99c]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:27:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0c21c925-e68e-4ff0-a3ba-b44a2717582b tempest-VolumesActionsTest-1846254690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_z3n7g2ax {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:05 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_z3n7g2ax Sep 01 08:27:05 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:05 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0c21c925-e68e-4ff0-a3ba-b44a2717582b tempest-VolumesActionsTest-1846254690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_z3n7g2ax" returned: 0 in 0.339s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:06 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0c21c925-e68e-4ff0-a3ba-b44a2717582b tempest-VolumesActionsTest-1846254690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.808s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:27:06 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0c21c925-e68e-4ff0-a3ba-b44a2717582b tempest-VolumesActionsTest-1846254690 None] Uploaded volume to glance image-id: 23e80caa-6747-42e2-8307-96ca2eaf87be. {{(pid=86893) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 08:27:06 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-0c21c925-e68e-4ff0-a3ba-b44a2717582b tempest-VolumesActionsTest-1846254690 None] Copy volume to image completed successfully. Sep 01 08:27:08 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-fc662f8c-02d1-4223-a2c2-1f8fac4d5bc3 tempest-VolumesActionsTest-1846254690 None] Acquiring lock "cinder-1cf5ef65-2af2-44c2-bb36-156373d4a02a-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:27:08 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-fc662f8c-02d1-4223-a2c2-1f8fac4d5bc3 tempest-VolumesActionsTest-1846254690 None] Lock "cinder-1cf5ef65-2af2-44c2-bb36-156373d4a02a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:27:08 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-fc662f8c-02d1-4223-a2c2-1f8fac4d5bc3 tempest-VolumesActionsTest-1846254690 None] Acquiring lock "cinder-quobyte-1cf5ef65-2af2-44c2-bb36-156373d4a02a" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:27:08 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-fc662f8c-02d1-4223-a2c2-1f8fac4d5bc3 tempest-VolumesActionsTest-1846254690 None] Lock "cinder-quobyte-1cf5ef65-2af2-44c2-bb36-156373d4a02a" acquired by "delete_volume" :: waited 0.021s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:27:08 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb07f0b-5cfb-47e5-9fad-9cc6ac133cd3]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:27:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fc662f8c-02d1-4223-a2c2-1f8fac4d5bc3 tempest-VolumesActionsTest-1846254690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:08 devstack sudo[100732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a Sep 01 08:27:08 devstack sudo[100732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:08 devstack sudo[100732]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fc662f8c-02d1-4223-a2c2-1f8fac4d5bc3 tempest-VolumesActionsTest-1846254690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a" returned: 0 in 0.378s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fc662f8c-02d1-4223-a2c2-1f8fac4d5bc3 tempest-VolumesActionsTest-1846254690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:08 devstack sudo[100737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a Sep 01 08:27:08 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:08 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fc662f8c-02d1-4223-a2c2-1f8fac4d5bc3 tempest-VolumesActionsTest-1846254690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-1cf5ef65-2af2-44c2-bb36-156373d4a02a" returned: 0 in 0.255s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:08 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-fc662f8c-02d1-4223-a2c2-1f8fac4d5bc3 tempest-VolumesActionsTest-1846254690 None] Lock "cinder-quobyte-1cf5ef65-2af2-44c2-bb36-156373d4a02a" released by "delete_volume" :: held 0.676s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:27:09 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-fc662f8c-02d1-4223-a2c2-1f8fac4d5bc3 tempest-VolumesActionsTest-1846254690 None] Created reservations ['5052755c-9db0-4390-b706-8d7ab5f8f342', 'e1a52dce-d96f-4c26-ba1e-9fd3bc50abad', 'e448b61a-fd3d-43e6-836d-5e6f8a4da33b', '44447004-d8f3-49f9-be11-01b246c1753c'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:27:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-fc662f8c-02d1-4223-a2c2-1f8fac4d5bc3 tempest-VolumesActionsTest-1846254690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:27:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-fc662f8c-02d1-4223-a2c2-1f8fac4d5bc3 tempest-VolumesActionsTest-1846254690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:27:09 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-fc662f8c-02d1-4223-a2c2-1f8fac4d5bc3 tempest-VolumesActionsTest-1846254690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:27:09 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-fc662f8c-02d1-4223-a2c2-1f8fac4d5bc3 tempest-VolumesActionsTest-1846254690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:27:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-fc662f8c-02d1-4223-a2c2-1f8fac4d5bc3 tempest-VolumesActionsTest-1846254690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:27:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fc662f8c-02d1-4223-a2c2-1f8fac4d5bc3 tempest-VolumesActionsTest-1846254690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:09 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:27:09 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:09 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fc662f8c-02d1-4223-a2c2-1f8fac4d5bc3 tempest-VolumesActionsTest-1846254690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.312s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:09 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-fc662f8c-02d1-4223-a2c2-1f8fac4d5bc3 tempest-VolumesActionsTest-1846254690 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:27:09 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-fc662f8c-02d1-4223-a2c2-1f8fac4d5bc3 tempest-VolumesActionsTest-1846254690 None] Deleted volume successfully. Sep 01 08:27:09 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-fc662f8c-02d1-4223-a2c2-1f8fac4d5bc3 tempest-VolumesActionsTest-1846254690 None] Lock "cinder-1cf5ef65-2af2-44c2-bb36-156373d4a02a-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:27:16 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:27:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Flow 'volume_create_manager' (2dcb4178-9392-4ef4-b5db-70f460e3e6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:27:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01cd686d-8c65-4c83-b1ff-93c4e989e9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:27:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01cd686d-8c65-4c83-b1ff-93c4e989e9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1861166034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bff4f7f-241f-439e-b0cc-56458ff6440b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e81e309da30e43be9d3b90134eeb8dd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:27:17Z,use_quota=True,user_id='4615c3a6b57b4a719d7ae55a5d10d9e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:27:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5788b6d2-a6b1-4015-b4c4-e7cb7e736188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:27:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5788b6d2-a6b1-4015-b4c4-e7cb7e736188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:27:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (643cfeeb-0d67-4cf6-9caf-05e31184961c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:27:16 devstack cinder-volume[86893]: DEBUG cinder.image.glance [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Creating Keystone auth plugin from conf {{(pid=86893) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 08:27:17 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (643cfeeb-0d67-4cf6-9caf-05e31184961c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2bff4f7f-241f-439e-b0cc-56458ff6440b', 'volume_name': 'volume-2bff4f7f-241f-439e-b0cc-56458ff6440b', 'volume_size': 1, 'image_id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a80c3dd0151a4e4aacd690bfb315fb01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'created_at': datetime.datetime(2026, 9, 1, 6, 7, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 6, 7, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:27:17 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d0635b-62d7-44c1-b8b6-129d080dcddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:27:17 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d0635b-62d7-44c1-b8b6-129d080dcddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:27:17 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6591afb-8a68-4edc-afae-19cb57002c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:27:17 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Volume 2bff4f7f-241f-439e-b0cc-56458ff6440b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2bff4f7f-241f-439e-b0cc-56458ff6440b', 'volume_size': 1, 'image_id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a80c3dd0151a4e4aacd690bfb315fb01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'created_at': datetime.datetime(2026, 9, 1, 6, 7, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 6, 7, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 08:27:17 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Trying to clone 2bff4f7f-241f-439e-b0cc-56458ff6440b from image 00f5a94d-dba5-4527-9ce8-7a00c3b29ced at location (None, [{'url': 'file:///opt/stack/data/glance/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'metadata': {}}]). {{(pid=86893) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1100}} Sep 01 08:27:17 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_7dkbjp4vdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86893) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 08:27:17 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Image download 20.69 MB at 20.69 MB/s Sep 01 08:27:17 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[c392c194-d506-4aa3-b204-21d8ca910d36]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:27:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_7dkbjp4vdevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:17 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_7dkbjp4vdevstack@QuobyteHD Sep 01 08:27:17 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:18 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_7dkbjp4vdevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:18 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Temporary image 00f5a94d-dba5-4527-9ce8-7a00c3b29ced is fetched for user 4615c3a6b57b4a719d7ae55a5d10d9e9. {{(pid=86893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 08:27:18 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8f3369-76d3-4a01-a3b7-daadba1df8c0]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:27:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_7dkbjp4vdevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:18 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_7dkbjp4vdevstack@QuobyteHD Sep 01 08:27:18 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:18 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_7dkbjp4vdevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:27:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:27:18 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1861166034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bff4f7f-241f-439e-b0cc-56458ff6440b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e81e309da30e43be9d3b90134eeb8dd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:27:17Z,use_quota=True,user_id='4615c3a6b57b4a719d7ae55a5d10d9e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:27:18 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Creating volume 2bff4f7f-241f-439e-b0cc-56458ff6440b {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:27:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:27:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:27:18 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:27:18 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:27:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:27:18 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:27:18 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:27:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2bff4f7f-241f-439e-b0cc-56458ff6440b 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:18 devstack sudo[100799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2bff4f7f-241f-439e-b0cc-56458ff6440b 1073741824 Sep 01 08:27:18 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:18 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2bff4f7f-241f-439e-b0cc-56458ff6440b 1073741824" returned: 0 in 0.471s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2bff4f7f-241f-439e-b0cc-56458ff6440b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:19 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2bff4f7f-241f-439e-b0cc-56458ff6440b Sep 01 08:27:19 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:19 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2bff4f7f-241f-439e-b0cc-56458ff6440b" returned: 0 in 0.249s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:19 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:27:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:27:19 devstack cinder-volume[86893]: DEBUG cinder.volume.volume_utils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Attempting download of 00f5a94d-dba5-4527-9ce8-7a00c3b29ced ((None, [{'url': 'file:///opt/stack/data/glance/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'metadata': {}}])) to volume 2bff4f7f-241f-439e-b0cc-56458ff6440b. {{(pid=86893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 08:27:19 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a41171-a33f-4207-b5c5-ff60f1d90873]: (4, 'raw') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:27:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced__rusgy6x {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:19 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced__rusgy6x Sep 01 08:27:19 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:19 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced__rusgy6x" returned: 0 in 0.347s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced__rusgy6x {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:19 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced__rusgy6x Sep 01 08:27:19 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:20 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced__rusgy6x" returned: 1 in 0.334s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced__rusgy6x' failed. Not Retrying. {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 08:27:20 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cf722b-eadb-46b0-9aa9-6aba0bfb8e5b]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:27:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_7dkbjp4vdevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:20 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_7dkbjp4vdevstack@QuobyteHD Sep 01 08:27:20 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:20 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_7dkbjp4vdevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:20 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] 00f5a94d-dba5-4527-9ce8-7a00c3b29ced was qcow2, converting to qcow2 {{(pid=86893) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 08:27:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_7dkbjp4vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2bff4f7f-241f-439e-b0cc-56458ff6440b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:20 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_7dkbjp4vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2bff4f7f-241f-439e-b0cc-56458ff6440b Sep 01 08:27:20 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:22 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_7dkbjp4vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2bff4f7f-241f-439e-b0cc-56458ff6440b" returned: 0 in 1.755s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:22 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_7dkbjp4vdevstack@QuobyteHD, size 112.00 MB, duration 1.76 sec, destination /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2bff4f7f-241f-439e-b0cc-56458ff6440b {{(pid=86893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 08:27:22 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Converted 112.00 MB image at 63.77 MB/s Sep 01 08:27:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2bff4f7f-241f-439e-b0cc-56458ff6440b 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:22 devstack sudo[100830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2bff4f7f-241f-439e-b0cc-56458ff6440b 1G Sep 01 08:27:22 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:22 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2bff4f7f-241f-439e-b0cc-56458ff6440b 1G" returned: 0 in 0.319s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:22 devstack cinder-volume[86893]: DEBUG cinder.volume.volume_utils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Downloaded image 00f5a94d-dba5-4527-9ce8-7a00c3b29ced ((None, [{'url': 'file:///opt/stack/data/glance/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'metadata': {}}])) to volume 2bff4f7f-241f-439e-b0cc-56458ff6440b successfully. {{(pid=86893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 08:27:22 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Temporary image 00f5a94d-dba5-4527-9ce8-7a00c3b29ced for user 4615c3a6b57b4a719d7ae55a5d10d9e9 is deleted. {{(pid=86893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 08:27:22 devstack cinder-volume[86893]: DEBUG cinder.volume.volume_utils [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Marking volume 2bff4f7f-241f-439e-b0cc-56458ff6440b as bootable. {{(pid=86893) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 08:27:22 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Copying metadata from image 00f5a94d-dba5-4527-9ce8-7a00c3b29ced to 2bff4f7f-241f-439e-b0cc-56458ff6440b. {{(pid=86893) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 08:27:22 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Creating volume glance metadata for volume 2bff4f7f-241f-439e-b0cc-56458ff6440b backed by image 00f5a94d-dba5-4527-9ce8-7a00c3b29ced with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86893) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 08:27:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6591afb-8a68-4edc-afae-19cb57002c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bff4f7f-241f-439e-b0cc-56458ff6440b', 'volume_size': 1, 'image_id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a80c3dd0151a4e4aacd690bfb315fb01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'created_at': datetime.datetime(2026, 9, 1, 6, 7, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 6, 7, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:27:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb423a2-1903-4d35-93a9-3faedeb99efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:27:22 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Volume volume-2bff4f7f-241f-439e-b0cc-56458ff6440b (2bff4f7f-241f-439e-b0cc-56458ff6440b): created successfully Sep 01 08:27:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb423a2-1903-4d35-93a9-3faedeb99efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:27:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Flow 'volume_create_manager' (2dcb4178-9392-4ef4-b5db-70f460e3e6fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:27:22 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-a0d31f97-3b32-4f81-8645-7f426abcca67 tempest-VolumesExtendTest-295165 None] Created volume successfully. Sep 01 08:27:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5c6259f3-1d28-4e59-a101-15f54d56241a tempest-VolumesExtendTest-295165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:27:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5c6259f3-1d28-4e59-a101-15f54d56241a tempest-VolumesExtendTest-295165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:27:23 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfd19e8-8433-4688-8a94-e710c8dca230]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:27:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5c6259f3-1d28-4e59-a101-15f54d56241a tempest-VolumesExtendTest-295165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2bff4f7f-241f-439e-b0cc-56458ff6440b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:23 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2bff4f7f-241f-439e-b0cc-56458ff6440b Sep 01 08:27:23 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:23 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5c6259f3-1d28-4e59-a101-15f54d56241a tempest-VolumesExtendTest-295165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2bff4f7f-241f-439e-b0cc-56458ff6440b" returned: 0 in 0.401s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5c6259f3-1d28-4e59-a101-15f54d56241a tempest-VolumesExtendTest-295165 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2bff4f7f-241f-439e-b0cc-56458ff6440b 2G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5c6259f3-1d28-4e59-a101-15f54d56241a tempest-VolumesExtendTest-295165 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2bff4f7f-241f-439e-b0cc-56458ff6440b 2G" returned: 0 in 0.112s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5c6259f3-1d28-4e59-a101-15f54d56241a tempest-VolumesExtendTest-295165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.541s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:27:23 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-5c6259f3-1d28-4e59-a101-15f54d56241a tempest-VolumesExtendTest-295165 None] Extend volume completed successfully. Sep 01 08:27:24 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-afacdf3c-6a5b-46ff-82a8-1094a572df94 tempest-VolumesExtendTest-295165 None] Acquiring lock "cinder-2bff4f7f-241f-439e-b0cc-56458ff6440b-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:27:24 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-afacdf3c-6a5b-46ff-82a8-1094a572df94 tempest-VolumesExtendTest-295165 None] Lock "cinder-2bff4f7f-241f-439e-b0cc-56458ff6440b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:27:24 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-afacdf3c-6a5b-46ff-82a8-1094a572df94 tempest-VolumesExtendTest-295165 None] Acquiring lock "cinder-quobyte-2bff4f7f-241f-439e-b0cc-56458ff6440b" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:27:24 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-afacdf3c-6a5b-46ff-82a8-1094a572df94 tempest-VolumesExtendTest-295165 None] Lock "cinder-quobyte-2bff4f7f-241f-439e-b0cc-56458ff6440b" acquired by "delete_volume" :: waited 0.018s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:27:24 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f8b7b8-8e4e-484f-b24c-f348287e122b]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:27:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-afacdf3c-6a5b-46ff-82a8-1094a572df94 tempest-VolumesExtendTest-295165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2bff4f7f-241f-439e-b0cc-56458ff6440b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:24 devstack sudo[100844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2bff4f7f-241f-439e-b0cc-56458ff6440b Sep 01 08:27:24 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:25 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-afacdf3c-6a5b-46ff-82a8-1094a572df94 tempest-VolumesExtendTest-295165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2bff4f7f-241f-439e-b0cc-56458ff6440b" returned: 0 in 0.378s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-afacdf3c-6a5b-46ff-82a8-1094a572df94 tempest-VolumesExtendTest-295165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2bff4f7f-241f-439e-b0cc-56458ff6440b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:25 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2bff4f7f-241f-439e-b0cc-56458ff6440b Sep 01 08:27:25 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:25 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-afacdf3c-6a5b-46ff-82a8-1094a572df94 tempest-VolumesExtendTest-295165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2bff4f7f-241f-439e-b0cc-56458ff6440b" returned: 0 in 0.258s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:25 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-afacdf3c-6a5b-46ff-82a8-1094a572df94 tempest-VolumesExtendTest-295165 None] Lock "cinder-quobyte-2bff4f7f-241f-439e-b0cc-56458ff6440b" released by "delete_volume" :: held 0.690s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:27:25 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-afacdf3c-6a5b-46ff-82a8-1094a572df94 tempest-VolumesExtendTest-295165 None] Created reservations ['e129b0d0-19ef-4da2-8ac9-bccfc107c023', '07cbff37-66c4-42ac-b0fb-0016caa36be3', '5085700c-f58e-4d36-95b1-86e9f6dad24c', '3a060923-837a-4cc8-a189-b6593b25f668'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:27:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-afacdf3c-6a5b-46ff-82a8-1094a572df94 tempest-VolumesExtendTest-295165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:27:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-afacdf3c-6a5b-46ff-82a8-1094a572df94 tempest-VolumesExtendTest-295165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:27:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-afacdf3c-6a5b-46ff-82a8-1094a572df94 tempest-VolumesExtendTest-295165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:27:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-afacdf3c-6a5b-46ff-82a8-1094a572df94 tempest-VolumesExtendTest-295165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:27:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-afacdf3c-6a5b-46ff-82a8-1094a572df94 tempest-VolumesExtendTest-295165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:27:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-afacdf3c-6a5b-46ff-82a8-1094a572df94 tempest-VolumesExtendTest-295165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:25 devstack sudo[100853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:27:25 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:25 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-afacdf3c-6a5b-46ff-82a8-1094a572df94 tempest-VolumesExtendTest-295165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.269s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:25 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-afacdf3c-6a5b-46ff-82a8-1094a572df94 tempest-VolumesExtendTest-295165 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:27:25 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-afacdf3c-6a5b-46ff-82a8-1094a572df94 tempest-VolumesExtendTest-295165 None] Deleted volume successfully. Sep 01 08:27:25 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-afacdf3c-6a5b-46ff-82a8-1094a572df94 tempest-VolumesExtendTest-295165 None] Lock "cinder-2bff4f7f-241f-439e-b0cc-56458ff6440b-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:27:26 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:27:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] Flow 'volume_create_manager' (9a12d921-02d5-42ac-a865-87d52eae4873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:27:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298836a6-bbc0-4557-a1b4-4caa1d78cf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:27:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298836a6-bbc0-4557-a1b4-4caa1d78cf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-22544261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=974c59ac-1c56-41d8-a129-5cdfb4967797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e81e309da30e43be9d3b90134eeb8dd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:27:26Z,use_quota=True,user_id='4615c3a6b57b4a719d7ae55a5d10d9e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:27:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cee64f1-8cb9-40ab-b412-1b7c342fabb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:27:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cee64f1-8cb9-40ab-b412-1b7c342fabb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:27:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e310020c-87ff-4139-a95b-e2551387c587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:27:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e310020c-87ff-4139-a95b-e2551387c587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '974c59ac-1c56-41d8-a129-5cdfb4967797', 'volume_name': 'volume-974c59ac-1c56-41d8-a129-5cdfb4967797', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:27:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1553141-7d0b-4296-a2f4-2c33475661f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:27:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1553141-7d0b-4296-a2f4-2c33475661f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:27:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7851e5a1-2ce2-4860-aa1c-c80d01a597e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:27:26 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] Volume 974c59ac-1c56-41d8-a129-5cdfb4967797: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-974c59ac-1c56-41d8-a129-5cdfb4967797', 'volume_size': 1} Sep 01 08:27:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:27:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:27:26 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-22544261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=974c59ac-1c56-41d8-a129-5cdfb4967797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e81e309da30e43be9d3b90134eeb8dd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:27:26Z,use_quota=True,user_id='4615c3a6b57b4a719d7ae55a5d10d9e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:27:26 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] Creating volume 974c59ac-1c56-41d8-a129-5cdfb4967797 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:27:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:27:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:27:26 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:27:26 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:27:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:27:26 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:27:26 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:27:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:26 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797 1073741824 Sep 01 08:27:26 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:27 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797 1073741824" returned: 0 in 0.505s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:27 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797 Sep 01 08:27:27 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:27 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797" returned: 0 in 0.272s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:27:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:27:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7851e5a1-2ce2-4860-aa1c-c80d01a597e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-974c59ac-1c56-41d8-a129-5cdfb4967797', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:27:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc78eb6-a36f-4c80-aed2-c5123187787d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:27:27 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] Volume volume-974c59ac-1c56-41d8-a129-5cdfb4967797 (974c59ac-1c56-41d8-a129-5cdfb4967797): created successfully Sep 01 08:27:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc78eb6-a36f-4c80-aed2-c5123187787d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:27:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] Flow 'volume_create_manager' (9a12d921-02d5-42ac-a865-87d52eae4873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:27:27 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-63e135ac-9a67-4da5-ad76-d92d5130fcbe tempest-VolumesExtendTest-295165 None] Created volume successfully. Sep 01 08:27:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2f1a98a6-5cd9-46d7-86c1-18e3805d4fb8 tempest-VolumesExtendTest-295165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:27:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2f1a98a6-5cd9-46d7-86c1-18e3805d4fb8 tempest-VolumesExtendTest-295165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:27:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-2f1a98a6-5cd9-46d7-86c1-18e3805d4fb8 tempest-VolumesExtendTest-295165 None] Creating offline snapshot f987dc88-fa29-4f6b-963c-b91d0112c917 of volume 974c59ac-1c56-41d8-a129-5cdfb4967797 {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:27:28 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[054ae570-a0ad-4467-8c64-e0f613fc2849]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:27:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2f1a98a6-5cd9-46d7-86c1-18e3805d4fb8 tempest-VolumesExtendTest-295165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:28 devstack sudo[100868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797 Sep 01 08:27:28 devstack sudo[100868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:29 devstack sudo[100868]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2f1a98a6-5cd9-46d7-86c1-18e3805d4fb8 tempest-VolumesExtendTest-295165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797" returned: 0 in 0.392s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2f1a98a6-5cd9-46d7-86c1-18e3805d4fb8 tempest-VolumesExtendTest-295165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797.f987dc88-fa29-4f6b-963c-b91d0112c917 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:29 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797.f987dc88-fa29-4f6b-963c-b91d0112c917 1G Sep 01 08:27:29 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:29 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2f1a98a6-5cd9-46d7-86c1-18e3805d4fb8 tempest-VolumesExtendTest-295165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797.f987dc88-fa29-4f6b-963c-b91d0112c917 1G" returned: 0 in 0.433s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2f1a98a6-5cd9-46d7-86c1-18e3805d4fb8 tempest-VolumesExtendTest-295165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-974c59ac-1c56-41d8-a129-5cdfb4967797 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797.f987dc88-fa29-4f6b-963c-b91d0112c917 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:29 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-974c59ac-1c56-41d8-a129-5cdfb4967797 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797.f987dc88-fa29-4f6b-963c-b91d0112c917 Sep 01 08:27:29 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:29 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:27:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] Flow 'volume_create_manager' (ce40f3ec-e850-4e74-aaaf-fc2ca09b8e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:27:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4088b3ec-e642-45ad-83f5-e65d7b67086e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:27:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4088b3ec-e642-45ad-83f5-e65d7b67086e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-144911584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e0e579-91d7-440d-9557-7c9649b27a78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e85352ff8b204459827d6fe14f995202',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:27:30Z,use_quota=True,user_id='3f0f400124a6436588bcc262e76892e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:27:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b28095-14cb-4b89-8ee1-fea7f1809eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:27:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b28095-14cb-4b89-8ee1-fea7f1809eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:27:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fbeb6f9-6e0b-499c-bd99-6a58b2f0ea88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:27:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fbeb6f9-6e0b-499c-bd99-6a58b2f0ea88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0e0e579-91d7-440d-9557-7c9649b27a78', 'volume_name': 'volume-a0e0e579-91d7-440d-9557-7c9649b27a78', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:27:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e09f59-21c6-404f-a0c8-a29e0aa41513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:27:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e09f59-21c6-404f-a0c8-a29e0aa41513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:27:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc33e308-bc95-4605-ac14-e295ff241e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:27:29 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] Volume a0e0e579-91d7-440d-9557-7c9649b27a78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0e0e579-91d7-440d-9557-7c9649b27a78', 'volume_size': 1} Sep 01 08:27:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:27:29 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2f1a98a6-5cd9-46d7-86c1-18e3805d4fb8 tempest-VolumesExtendTest-295165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-974c59ac-1c56-41d8-a129-5cdfb4967797 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797.f987dc88-fa29-4f6b-963c-b91d0112c917" returned: 0 in 0.355s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:29 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-2f1a98a6-5cd9-46d7-86c1-18e3805d4fb8 tempest-VolumesExtendTest-295165 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797.f987dc88-fa29-4f6b-963c-b91d0112c917 is being set with open permissions: ugo+rw Sep 01 08:27:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2f1a98a6-5cd9-46d7-86c1-18e3805d4fb8 tempest-VolumesExtendTest-295165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797.f987dc88-fa29-4f6b-963c-b91d0112c917 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:29 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797.f987dc88-fa29-4f6b-963c-b91d0112c917 Sep 01 08:27:29 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:30 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2f1a98a6-5cd9-46d7-86c1-18e3805d4fb8 tempest-VolumesExtendTest-295165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797.f987dc88-fa29-4f6b-963c-b91d0112c917" returned: 0 in 0.262s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2f1a98a6-5cd9-46d7-86c1-18e3805d4fb8 tempest-VolumesExtendTest-295165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:30 devstack sudo[100889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797.info Sep 01 08:27:30 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:30 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2f1a98a6-5cd9-46d7-86c1-18e3805d4fb8 tempest-VolumesExtendTest-295165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797.info" returned: 0 in 0.281s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:30 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-2f1a98a6-5cd9-46d7-86c1-18e3805d4fb8 tempest-VolumesExtendTest-295165 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797.info is being set with open permissions: ugo+rw Sep 01 08:27:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2f1a98a6-5cd9-46d7-86c1-18e3805d4fb8 tempest-VolumesExtendTest-295165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:30 devstack sudo[100895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797.info Sep 01 08:27:30 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:30 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2f1a98a6-5cd9-46d7-86c1-18e3805d4fb8 tempest-VolumesExtendTest-295165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797.info" returned: 0 in 0.271s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2f1a98a6-5cd9-46d7-86c1-18e3805d4fb8 tempest-VolumesExtendTest-295165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.088s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:27:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.932s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:27:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-144911584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e0e579-91d7-440d-9557-7c9649b27a78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e85352ff8b204459827d6fe14f995202',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:27:30Z,use_quota=True,user_id='3f0f400124a6436588bcc262e76892e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:27:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] Creating volume a0e0e579-91d7-440d-9557-7c9649b27a78 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:27:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:27:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:27:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:27:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:27:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:27:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:27:30 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:27:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:30 devstack sudo[100898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78 1073741824 Sep 01 08:27:30 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:30 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-2f1a98a6-5cd9-46d7-86c1-18e3805d4fb8 tempest-VolumesExtendTest-295165 None] Create snapshot completed successfully Sep 01 08:27:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:27:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:27:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:27:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:27:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:27:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:27:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:31 devstack sudo[100903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:27:31 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:31 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78 1073741824" returned: 0 in 0.492s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:31 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78 Sep 01 08:27:31 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:31 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.277s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:31 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:27:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager._thread_info {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:27:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread count: 28 {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 08:27:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread info: [<_MainThread(MainThread, started 138934582050944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 08:27:31 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78" returned: 0 in 0.290s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:27:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:27:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc33e308-bc95-4605-ac14-e295ff241e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0e0e579-91d7-440d-9557-7c9649b27a78', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:27:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5de67548-f697-4130-a266-484d7e153434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:27:31 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] Volume volume-a0e0e579-91d7-440d-9557-7c9649b27a78 (a0e0e579-91d7-440d-9557-7c9649b27a78): created successfully Sep 01 08:27:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5de67548-f697-4130-a266-484d7e153434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:27:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] Flow 'volume_create_manager' (ce40f3ec-e850-4e74-aaaf-fc2ca09b8e84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:27:31 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-67563da2-02ab-43d7-95b7-dbc2272ff877 tempest-TestStampPattern-1916184424 None] Created volume successfully. Sep 01 08:27:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-10210c1f-4ada-4428-93ea-e8a30011fe6f tempest-VolumesExtendTest-295165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:27:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-10210c1f-4ada-4428-93ea-e8a30011fe6f tempest-VolumesExtendTest-295165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:27:32 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc4f9bf-2982-4ad3-89d0-dc71eecd981a]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:27:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-10210c1f-4ada-4428-93ea-e8a30011fe6f tempest-VolumesExtendTest-295165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:32 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797 Sep 01 08:27:32 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:32 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-10210c1f-4ada-4428-93ea-e8a30011fe6f tempest-VolumesExtendTest-295165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797" returned: 0 in 0.403s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-10210c1f-4ada-4428-93ea-e8a30011fe6f tempest-VolumesExtendTest-295165 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797.f987dc88-fa29-4f6b-963c-b91d0112c917 2G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-10210c1f-4ada-4428-93ea-e8a30011fe6f tempest-VolumesExtendTest-295165 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797.f987dc88-fa29-4f6b-963c-b91d0112c917 2G" returned: 0 in 0.203s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-10210c1f-4ada-4428-93ea-e8a30011fe6f tempest-VolumesExtendTest-295165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.690s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:27:32 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-10210c1f-4ada-4428-93ea-e8a30011fe6f tempest-VolumesExtendTest-295165 None] Extend volume completed successfully. Sep 01 08:27:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6c97efd0-7068-479b-b5e7-0515948f51fe tempest-VolumesExtendTest-295165 None] Acquiring lock "cinder-f987dc88-fa29-4f6b-963c-b91d0112c917-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:27:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6c97efd0-7068-479b-b5e7-0515948f51fe tempest-VolumesExtendTest-295165 None] Lock "cinder-f987dc88-fa29-4f6b-963c-b91d0112c917-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:27:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6c97efd0-7068-479b-b5e7-0515948f51fe tempest-VolumesExtendTest-295165 None] Acquiring lock "cinder-quobyte-974c59ac-1c56-41d8-a129-5cdfb4967797" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:27:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6c97efd0-7068-479b-b5e7-0515948f51fe tempest-VolumesExtendTest-295165 None] Lock "cinder-quobyte-974c59ac-1c56-41d8-a129-5cdfb4967797" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:27:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6c97efd0-7068-479b-b5e7-0515948f51fe tempest-VolumesExtendTest-295165 None] Acquiring lock "cinder-quobyte-f987dc88-fa29-4f6b-963c-b91d0112c917" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:27:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6c97efd0-7068-479b-b5e7-0515948f51fe tempest-VolumesExtendTest-295165 None] Lock "cinder-quobyte-f987dc88-fa29-4f6b-963c-b91d0112c917" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:27:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-6c97efd0-7068-479b-b5e7-0515948f51fe tempest-VolumesExtendTest-295165 None] Deleting offline snapshot f987dc88-fa29-4f6b-963c-b91d0112c917 of volume 974c59ac-1c56-41d8-a129-5cdfb4967797 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:27:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-6c97efd0-7068-479b-b5e7-0515948f51fe tempest-VolumesExtendTest-295165 None] snapshot_file for this snap is: volume-974c59ac-1c56-41d8-a129-5cdfb4967797.f987dc88-fa29-4f6b-963c-b91d0112c917 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:27:33 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[405cbc84-1afe-4563-8c09-25966a128431]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:27:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6c97efd0-7068-479b-b5e7-0515948f51fe tempest-VolumesExtendTest-295165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797.f987dc88-fa29-4f6b-963c-b91d0112c917 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:33 devstack sudo[100935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797.f987dc88-fa29-4f6b-963c-b91d0112c917 Sep 01 08:27:33 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:33 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6c97efd0-7068-479b-b5e7-0515948f51fe tempest-VolumesExtendTest-295165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797.f987dc88-fa29-4f6b-963c-b91d0112c917" returned: 0 in 0.396s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-6c97efd0-7068-479b-b5e7-0515948f51fe tempest-VolumesExtendTest-295165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-974c59ac-1c56-41d8-a129-5cdfb4967797(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:27:33 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfddb3e-0b81-47a4-8194-028abbe40f2b]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:27:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6c97efd0-7068-479b-b5e7-0515948f51fe tempest-VolumesExtendTest-295165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:33 devstack sudo[100941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797 Sep 01 08:27:33 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:34 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6c97efd0-7068-479b-b5e7-0515948f51fe tempest-VolumesExtendTest-295165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797" returned: 0 in 0.406s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6c97efd0-7068-479b-b5e7-0515948f51fe tempest-VolumesExtendTest-295165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797.f987dc88-fa29-4f6b-963c-b91d0112c917 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:34 devstack sudo[100946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797.f987dc88-fa29-4f6b-963c-b91d0112c917 Sep 01 08:27:34 devstack sudo[100946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:34 devstack sudo[100946]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6c97efd0-7068-479b-b5e7-0515948f51fe tempest-VolumesExtendTest-295165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797.f987dc88-fa29-4f6b-963c-b91d0112c917" returned: 0 in 0.665s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6c97efd0-7068-479b-b5e7-0515948f51fe tempest-VolumesExtendTest-295165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797.f987dc88-fa29-4f6b-963c-b91d0112c917 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:34 devstack sudo[101007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797.f987dc88-fa29-4f6b-963c-b91d0112c917 Sep 01 08:27:34 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:35 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6c97efd0-7068-479b-b5e7-0515948f51fe tempest-VolumesExtendTest-295165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797.f987dc88-fa29-4f6b-963c-b91d0112c917" returned: 0 in 0.337s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6c97efd0-7068-479b-b5e7-0515948f51fe tempest-VolumesExtendTest-295165 None] Lock "cinder-quobyte-f987dc88-fa29-4f6b-963c-b91d0112c917" released by "_delete_snapshot" :: held 1.974s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:27:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6c97efd0-7068-479b-b5e7-0515948f51fe tempest-VolumesExtendTest-295165 None] Lock "cinder-quobyte-974c59ac-1c56-41d8-a129-5cdfb4967797" released by "delete_snapshot" :: held 2.002s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:27:35 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-6c97efd0-7068-479b-b5e7-0515948f51fe tempest-VolumesExtendTest-295165 None] Created reservations ['55f6d6be-edeb-45e3-9246-0ab4eea2fdb5', 'b51b03c9-dc5c-47cf-9c00-d5b40453b69e', '9333867a-1819-4579-8345-a5f63042a22f', '2405ca6d-1f6a-44b4-8385-d1ebe630cd00'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:27:35 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-6c97efd0-7068-479b-b5e7-0515948f51fe tempest-VolumesExtendTest-295165 None] Delete snapshot completed successfully. Sep 01 08:27:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6c97efd0-7068-479b-b5e7-0515948f51fe tempest-VolumesExtendTest-295165 None] Lock "cinder-f987dc88-fa29-4f6b-963c-b91d0112c917-delete_snapshot" released by "delete_snapshot" :: held 2.170s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:27:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-220d11fb-4982-4ea4-92f1-11b163254d4d tempest-VolumesExtendTest-295165 None] Acquiring lock "cinder-974c59ac-1c56-41d8-a129-5cdfb4967797-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:27:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-220d11fb-4982-4ea4-92f1-11b163254d4d tempest-VolumesExtendTest-295165 None] Lock "cinder-974c59ac-1c56-41d8-a129-5cdfb4967797-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:27:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-220d11fb-4982-4ea4-92f1-11b163254d4d tempest-VolumesExtendTest-295165 None] Acquiring lock "cinder-quobyte-974c59ac-1c56-41d8-a129-5cdfb4967797" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:27:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-220d11fb-4982-4ea4-92f1-11b163254d4d tempest-VolumesExtendTest-295165 None] Lock "cinder-quobyte-974c59ac-1c56-41d8-a129-5cdfb4967797" acquired by "delete_volume" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:27:35 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d374ae-4708-41ef-b891-e193a2ad986f]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:27:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-220d11fb-4982-4ea4-92f1-11b163254d4d tempest-VolumesExtendTest-295165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:35 devstack sudo[101021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797 Sep 01 08:27:35 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:36 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-220d11fb-4982-4ea4-92f1-11b163254d4d tempest-VolumesExtendTest-295165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797" returned: 0 in 0.454s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-220d11fb-4982-4ea4-92f1-11b163254d4d tempest-VolumesExtendTest-295165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:36 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797 Sep 01 08:27:36 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:36 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-220d11fb-4982-4ea4-92f1-11b163254d4d tempest-VolumesExtendTest-295165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-974c59ac-1c56-41d8-a129-5cdfb4967797" returned: 0 in 0.270s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:36 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-220d11fb-4982-4ea4-92f1-11b163254d4d tempest-VolumesExtendTest-295165 None] Lock "cinder-quobyte-974c59ac-1c56-41d8-a129-5cdfb4967797" released by "delete_volume" :: held 0.796s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:27:36 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-220d11fb-4982-4ea4-92f1-11b163254d4d tempest-VolumesExtendTest-295165 None] Created reservations ['6cdb97d9-5194-4b03-be1a-1da7ec3252fe', '4e9b7f28-d14c-4e4c-9958-b708e50b7997', 'c7de5a42-65e8-47ae-a115-9a08498b678e', '0b88aace-c299-4f07-abac-b7374b72a0aa'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:27:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-220d11fb-4982-4ea4-92f1-11b163254d4d tempest-VolumesExtendTest-295165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:27:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-220d11fb-4982-4ea4-92f1-11b163254d4d tempest-VolumesExtendTest-295165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:27:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-220d11fb-4982-4ea4-92f1-11b163254d4d tempest-VolumesExtendTest-295165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:27:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-220d11fb-4982-4ea4-92f1-11b163254d4d tempest-VolumesExtendTest-295165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:27:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-220d11fb-4982-4ea4-92f1-11b163254d4d tempest-VolumesExtendTest-295165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:27:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-220d11fb-4982-4ea4-92f1-11b163254d4d tempest-VolumesExtendTest-295165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:36 devstack sudo[101031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:27:36 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:36 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-220d11fb-4982-4ea4-92f1-11b163254d4d tempest-VolumesExtendTest-295165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.305s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:36 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-220d11fb-4982-4ea4-92f1-11b163254d4d tempest-VolumesExtendTest-295165 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:27:36 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-220d11fb-4982-4ea4-92f1-11b163254d4d tempest-VolumesExtendTest-295165 None] Deleted volume successfully. Sep 01 08:27:36 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-220d11fb-4982-4ea4-92f1-11b163254d4d tempest-VolumesExtendTest-295165 None] Lock "cinder-974c59ac-1c56-41d8-a129-5cdfb4967797-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:27:40 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:27:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] Flow 'volume_create_manager' (c09f7e75-7e51-4a38-a95f-2fe490da6eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:27:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (141645db-ca16-43b6-9b2d-529d0bbff946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:27:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (141645db-ca16-43b6-9b2d-529d0bbff946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2031397841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8deeb32-256d-4b88-aaef-76e06d4a1100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75baf79a0f54406995c5ad0b8096c8cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:27:40Z,use_quota=True,user_id='62283d8dd2b94dd89093338e969ef8a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:27:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7d3fe2-fb65-4fa2-b43a-112579e4644f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:27:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7d3fe2-fb65-4fa2-b43a-112579e4644f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:27:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14cf639c-ecb6-458d-b65e-e467b0a76bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:27:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14cf639c-ecb6-458d-b65e-e467b0a76bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8deeb32-256d-4b88-aaef-76e06d4a1100', 'volume_name': 'volume-d8deeb32-256d-4b88-aaef-76e06d4a1100', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:27:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e5e02f-bed7-4bfb-a11d-6058d1a704ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:27:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e5e02f-bed7-4bfb-a11d-6058d1a704ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:27:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad18796c-8ca7-4fdc-b063-5e9668e7fbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:27:40 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] Volume d8deeb32-256d-4b88-aaef-76e06d4a1100: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8deeb32-256d-4b88-aaef-76e06d4a1100', 'volume_size': 1} Sep 01 08:27:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:27:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:27:40 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2031397841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8deeb32-256d-4b88-aaef-76e06d4a1100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75baf79a0f54406995c5ad0b8096c8cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:27:40Z,use_quota=True,user_id='62283d8dd2b94dd89093338e969ef8a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:27:40 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] Creating volume d8deeb32-256d-4b88-aaef-76e06d4a1100 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:27:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:27:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:27:40 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:27:40 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:27:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:27:40 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:27:40 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:27:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d8deeb32-256d-4b88-aaef-76e06d4a1100 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:40 devstack sudo[101037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d8deeb32-256d-4b88-aaef-76e06d4a1100 1073741824 Sep 01 08:27:40 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:40 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d8deeb32-256d-4b88-aaef-76e06d4a1100 1073741824" returned: 0 in 0.413s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d8deeb32-256d-4b88-aaef-76e06d4a1100 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:40 devstack sudo[101042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d8deeb32-256d-4b88-aaef-76e06d4a1100 Sep 01 08:27:40 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:41 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d8deeb32-256d-4b88-aaef-76e06d4a1100" returned: 0 in 0.246s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:41 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:27:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:27:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad18796c-8ca7-4fdc-b063-5e9668e7fbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8deeb32-256d-4b88-aaef-76e06d4a1100', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:27:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f9968bd-ae7d-4ecc-a7c6-aa1a7cae1cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:27:41 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] Volume volume-d8deeb32-256d-4b88-aaef-76e06d4a1100 (d8deeb32-256d-4b88-aaef-76e06d4a1100): created successfully Sep 01 08:27:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f9968bd-ae7d-4ecc-a7c6-aa1a7cae1cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:27:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] Flow 'volume_create_manager' (c09f7e75-7e51-4a38-a95f-2fe490da6eb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:27:41 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-13ba8049-cb14-4438-92bb-ce5b7f354093 tempest-VolumesNegativeTest-224521949 None] Created volume successfully. Sep 01 08:27:51 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:UPDATE=58,cinder:SELECT=49,cinder:DELETE=6,cinder:INSERT=19 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:27:51 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=53,cinder:INSERT=20,cinder:UPDATE=64,cinder:DELETE=4 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:27:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-162387ae-7343-4f74-983c-e869da3d73f1 tempest-VolumesNegativeTest-224521949 None] Acquiring lock "cinder-d8deeb32-256d-4b88-aaef-76e06d4a1100-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:27:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-162387ae-7343-4f74-983c-e869da3d73f1 tempest-VolumesNegativeTest-224521949 None] Lock "cinder-d8deeb32-256d-4b88-aaef-76e06d4a1100-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:27:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-162387ae-7343-4f74-983c-e869da3d73f1 tempest-VolumesNegativeTest-224521949 None] Acquiring lock "cinder-quobyte-d8deeb32-256d-4b88-aaef-76e06d4a1100" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:27:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-162387ae-7343-4f74-983c-e869da3d73f1 tempest-VolumesNegativeTest-224521949 None] Lock "cinder-quobyte-d8deeb32-256d-4b88-aaef-76e06d4a1100" acquired by "delete_volume" :: waited 0.016s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:27:56 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1467ca-68ca-4fd3-b667-4f1f4e02e103]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:27:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-162387ae-7343-4f74-983c-e869da3d73f1 tempest-VolumesNegativeTest-224521949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d8deeb32-256d-4b88-aaef-76e06d4a1100 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:56 devstack sudo[101180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d8deeb32-256d-4b88-aaef-76e06d4a1100 Sep 01 08:27:56 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:57 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-162387ae-7343-4f74-983c-e869da3d73f1 tempest-VolumesNegativeTest-224521949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d8deeb32-256d-4b88-aaef-76e06d4a1100" returned: 0 in 0.388s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-162387ae-7343-4f74-983c-e869da3d73f1 tempest-VolumesNegativeTest-224521949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d8deeb32-256d-4b88-aaef-76e06d4a1100 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:57 devstack sudo[101185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d8deeb32-256d-4b88-aaef-76e06d4a1100 Sep 01 08:27:57 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:57 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-162387ae-7343-4f74-983c-e869da3d73f1 tempest-VolumesNegativeTest-224521949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d8deeb32-256d-4b88-aaef-76e06d4a1100" returned: 0 in 0.246s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-162387ae-7343-4f74-983c-e869da3d73f1 tempest-VolumesNegativeTest-224521949 None] Lock "cinder-quobyte-d8deeb32-256d-4b88-aaef-76e06d4a1100" released by "delete_volume" :: held 0.678s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:27:57 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-162387ae-7343-4f74-983c-e869da3d73f1 tempest-VolumesNegativeTest-224521949 None] Created reservations ['fff74887-7477-4dc7-b75d-695ca886315f', 'b213ea5c-5a7e-47a7-afe0-5001ca65e307', '1d6aad4a-258b-4baa-990f-a20f222c9c16', '1aa66e7e-f77b-473a-8332-9d38673b0e0d'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:27:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-162387ae-7343-4f74-983c-e869da3d73f1 tempest-VolumesNegativeTest-224521949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:27:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-162387ae-7343-4f74-983c-e869da3d73f1 tempest-VolumesNegativeTest-224521949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:27:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-162387ae-7343-4f74-983c-e869da3d73f1 tempest-VolumesNegativeTest-224521949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:27:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-162387ae-7343-4f74-983c-e869da3d73f1 tempest-VolumesNegativeTest-224521949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:27:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-162387ae-7343-4f74-983c-e869da3d73f1 tempest-VolumesNegativeTest-224521949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:27:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-162387ae-7343-4f74-983c-e869da3d73f1 tempest-VolumesNegativeTest-224521949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:27:57 devstack sudo[101189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:27:57 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:27:57 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root Sep 01 08:27:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-162387ae-7343-4f74-983c-e869da3d73f1 tempest-VolumesNegativeTest-224521949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.249s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:27:57 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-162387ae-7343-4f74-983c-e869da3d73f1 tempest-VolumesNegativeTest-224521949 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:27:57 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-162387ae-7343-4f74-983c-e869da3d73f1 tempest-VolumesNegativeTest-224521949 None] Deleted volume successfully. Sep 01 08:27:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-162387ae-7343-4f74-983c-e869da3d73f1 tempest-VolumesNegativeTest-224521949 None] Lock "cinder-d8deeb32-256d-4b88-aaef-76e06d4a1100-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:28:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-238c94e7-83dc-4be6-8094-ea7cda4fa7d6 req-3a13faf2-b672-432d-8b27-8dba67e86c74 tempest-TestStampPattern-1916184424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:28:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-238c94e7-83dc-4be6-8094-ea7cda4fa7d6 req-3a13faf2-b672-432d-8b27-8dba67e86c74 tempest-TestStampPattern-1916184424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:28:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-238c94e7-83dc-4be6-8094-ea7cda4fa7d6 req-3a13faf2-b672-432d-8b27-8dba67e86c74 tempest-TestStampPattern-1916184424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:28:00 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-238c94e7-83dc-4be6-8094-ea7cda4fa7d6 req-3a13faf2-b672-432d-8b27-8dba67e86c74 tempest-TestStampPattern-1916184424 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049', 'name': 'volume-a0e0e579-91d7-440d-9557-7c9649b27a78', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '01b87b8c-ea70-471e-ae44-97c6dde79381', 'enforce_multipath': True} {{(pid=86893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 08:28:00 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-238c94e7-83dc-4be6-8094-ea7cda4fa7d6 req-3a13faf2-b672-432d-8b27-8dba67e86c74 tempest-TestStampPattern-1916184424 None] attachment_update completed successfully. Sep 01 08:28:05 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-6c1177d5-1d86-45a8-a612-efaa285995b1 req-407d6ca2-2615-4870-a6ec-3ae98f9b4783 tempest-TestStampPattern-1916184424 None] Terminate volume connection completed successfully. Sep 01 08:28:05 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-6c1177d5-1d86-45a8-a612-efaa285995b1 req-407d6ca2-2615-4870-a6ec-3ae98f9b4783 tempest-TestStampPattern-1916184424 None] Deleting attachment 01b87b8c-ea70-471e-ae44-97c6dde79381. {{(pid=86893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 08:28:06 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b7297c1b-c574-46ba-965e-09dbe9e4b9af tempest-TestStampPattern-1916184424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:28:06 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b7297c1b-c574-46ba-965e-09dbe9e4b9af tempest-TestStampPattern-1916184424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:28:06 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-b7297c1b-c574-46ba-965e-09dbe9e4b9af tempest-TestStampPattern-1916184424 None] Creating offline snapshot cf7b4bba-1694-4046-8c31-a185dcd95a40 of volume a0e0e579-91d7-440d-9557-7c9649b27a78 {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:28:06 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c6d85d-ca90-4b04-bdd0-f097ec090b94]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:28:06 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b7297c1b-c574-46ba-965e-09dbe9e4b9af tempest-TestStampPattern-1916184424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:28:07 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78 Sep 01 08:28:07 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:28:07 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Sep 01 08:28:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b7297c1b-c574-46ba-965e-09dbe9e4b9af tempest-TestStampPattern-1916184424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78" returned: 0 in 0.373s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:28:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b7297c1b-c574-46ba-965e-09dbe9e4b9af tempest-TestStampPattern-1916184424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78.cf7b4bba-1694-4046-8c31-a185dcd95a40 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:28:07 devstack sudo[101644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78.cf7b4bba-1694-4046-8c31-a185dcd95a40 1G Sep 01 08:28:07 devstack sudo[101644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:28:07 devstack sudo[101644]: pam_unix(sudo:session): session closed for user root Sep 01 08:28:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b7297c1b-c574-46ba-965e-09dbe9e4b9af tempest-TestStampPattern-1916184424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78.cf7b4bba-1694-4046-8c31-a185dcd95a40 1G" returned: 0 in 0.426s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:28:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b7297c1b-c574-46ba-965e-09dbe9e4b9af tempest-TestStampPattern-1916184424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0e0e579-91d7-440d-9557-7c9649b27a78 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78.cf7b4bba-1694-4046-8c31-a185dcd95a40 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:28:07 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0e0e579-91d7-440d-9557-7c9649b27a78 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78.cf7b4bba-1694-4046-8c31-a185dcd95a40 Sep 01 08:28:07 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:28:07 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Sep 01 08:28:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b7297c1b-c574-46ba-965e-09dbe9e4b9af tempest-TestStampPattern-1916184424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0e0e579-91d7-440d-9557-7c9649b27a78 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78.cf7b4bba-1694-4046-8c31-a185dcd95a40" returned: 0 in 0.306s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:28:08 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-b7297c1b-c574-46ba-965e-09dbe9e4b9af tempest-TestStampPattern-1916184424 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78.cf7b4bba-1694-4046-8c31-a185dcd95a40 is being set with open permissions: ugo+rw Sep 01 08:28:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b7297c1b-c574-46ba-965e-09dbe9e4b9af tempest-TestStampPattern-1916184424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78.cf7b4bba-1694-4046-8c31-a185dcd95a40 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:28:08 devstack sudo[101656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78.cf7b4bba-1694-4046-8c31-a185dcd95a40 Sep 01 08:28:08 devstack sudo[101656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:28:08 devstack sudo[101656]: pam_unix(sudo:session): session closed for user root Sep 01 08:28:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b7297c1b-c574-46ba-965e-09dbe9e4b9af tempest-TestStampPattern-1916184424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78.cf7b4bba-1694-4046-8c31-a185dcd95a40" returned: 0 in 0.239s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:28:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b7297c1b-c574-46ba-965e-09dbe9e4b9af tempest-TestStampPattern-1916184424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:28:08 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78.info Sep 01 08:28:08 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:28:08 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Sep 01 08:28:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b7297c1b-c574-46ba-965e-09dbe9e4b9af tempest-TestStampPattern-1916184424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78.info" returned: 0 in 0.247s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:28:08 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-b7297c1b-c574-46ba-965e-09dbe9e4b9af tempest-TestStampPattern-1916184424 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78.info is being set with open permissions: ugo+rw Sep 01 08:28:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b7297c1b-c574-46ba-965e-09dbe9e4b9af tempest-TestStampPattern-1916184424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:28:08 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78.info Sep 01 08:28:08 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:28:08 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Sep 01 08:28:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b7297c1b-c574-46ba-965e-09dbe9e4b9af tempest-TestStampPattern-1916184424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78.info" returned: 0 in 0.269s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:28:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b7297c1b-c574-46ba-965e-09dbe9e4b9af tempest-TestStampPattern-1916184424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.959s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:28:08 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-b7297c1b-c574-46ba-965e-09dbe9e4b9af tempest-TestStampPattern-1916184424 None] Create snapshot completed successfully Sep 01 08:28:15 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:28:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Flow 'volume_create_manager' (54db7298-8038-4164-94b0-e664a05f8ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:28:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d694e9-c7d2-419c-80ba-a24e694abc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:28:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d694e9-c7d2-419c-80ba-a24e694abc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1266769011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef41d901-3272-4020-bd95-d2e98277fbd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e85352ff8b204459827d6fe14f995202',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cf7b4bba-1694-4046-8c31-a185dcd95a40,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:28:16Z,use_quota=True,user_id='3f0f400124a6436588bcc262e76892e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:28:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89537e53-bda7-41ef-926e-4c8dd34941e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:28:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89537e53-bda7-41ef-926e-4c8dd34941e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:28:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e963e9-45ca-4e06-9233-82d5f596e4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:28:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e963e9-45ca-4e06-9233-82d5f596e4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ef41d901-3272-4020-bd95-d2e98277fbd8', 'volume_name': 'volume-ef41d901-3272-4020-bd95-d2e98277fbd8', 'volume_size': 1, 'snapshot_id': 'cf7b4bba-1694-4046-8c31-a185dcd95a40'}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:28:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3647773-4b80-420b-9111-1aff6e0f8c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:28:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3647773-4b80-420b-9111-1aff6e0f8c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:28:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f81826-337f-4f70-bfa0-787e3ecadc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:28:15 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Volume ef41d901-3272-4020-bd95-d2e98277fbd8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ef41d901-3272-4020-bd95-d2e98277fbd8', 'volume_size': 1, 'snapshot_id': 'cf7b4bba-1694-4046-8c31-a185dcd95a40'} Sep 01 08:28:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:28:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:28:15 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Acquiring lock "cinder-quobyte-cf7b4bba-1694-4046-8c31-a185dcd95a40-ef41d901-3272-4020-bd95-d2e98277fbd8" by "_create_volume_from_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:28:15 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Lock "cinder-quobyte-cf7b4bba-1694-4046-8c31-a185dcd95a40-ef41d901-3272-4020-bd95-d2e98277fbd8" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:28:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Creating volume ef41d901-3272-4020-bd95-d2e98277fbd8 from snapshot cf7b4bba-1694-4046-8c31-a185dcd95a40 {{(pid=86893) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 08:28:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:28:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:28:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:28:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:28:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:28:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:28:16 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Acquiring lock "cinder-quobyte-ef41d901-3272-4020-bd95-d2e98277fbd8" by "_copy_volume_from_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:28:16 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Lock "cinder-quobyte-ef41d901-3272-4020-bd95-d2e98277fbd8" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:28:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] snapshot: cf7b4bba-1694-4046-8c31-a185dcd95a40, volume: ef41d901-3272-4020-bd95-d2e98277fbd8, {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 08:28:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:28:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:28:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:28:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:28:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:28:16 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdbfa6d-0421-4480-8abc-0ac105805466]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:28:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78.cf7b4bba-1694-4046-8c31-a185dcd95a40 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:28:16 devstack sudo[101732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78.cf7b4bba-1694-4046-8c31-a185dcd95a40 Sep 01 08:28:16 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:28:16 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root Sep 01 08:28:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78.cf7b4bba-1694-4046-8c31-a185dcd95a40" returned: 0 in 0.385s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:28:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0e0e579-91d7-440d-9557-7c9649b27a78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:28:16 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edc30df-24c9-46bc-bf0e-2697a9f883fb]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:28:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:28:16 devstack sudo[101737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78 Sep 01 08:28:16 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:28:16 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root Sep 01 08:28:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78" returned: 0 in 0.436s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:28:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78 {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 08:28:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Creating direct copy from snapshot {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 08:28:16 devstack cinder-volume[86893]: DEBUG cinder.utils [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Path /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef41d901-3272-4020-bd95-d2e98277fbd8 not found in is_blk_device check {{(pid=86893) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 08:28:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef41d901-3272-4020-bd95-d2e98277fbd8 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:28:16 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef41d901-3272-4020-bd95-d2e98277fbd8 Sep 01 08:28:16 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:28:23 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Sep 01 08:28:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef41d901-3272-4020-bd95-d2e98277fbd8" returned: 0 in 6.492s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:28:23 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Image conversion details: src /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78, size 1024.00 MB, duration 6.49 sec, destination /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef41d901-3272-4020-bd95-d2e98277fbd8 {{(pid=86893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 08:28:23 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Converted 1024.00 MB image at 157.71 MB/s Sep 01 08:28:23 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef41d901-3272-4020-bd95-d2e98277fbd8 is being set with open permissions: ugo+rw Sep 01 08:28:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef41d901-3272-4020-bd95-d2e98277fbd8 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:28:23 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef41d901-3272-4020-bd95-d2e98277fbd8 Sep 01 08:28:23 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:28:23 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Sep 01 08:28:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef41d901-3272-4020-bd95-d2e98277fbd8" returned: 0 in 0.371s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:28:23 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Lock "cinder-quobyte-ef41d901-3272-4020-bd95-d2e98277fbd8" released by "_copy_volume_from_snapshot" :: held 7.775s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:28:23 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Lock "cinder-quobyte-cf7b4bba-1694-4046-8c31-a185dcd95a40-ef41d901-3272-4020-bd95-d2e98277fbd8" released by "_create_volume_from_snapshot" :: held 7.861s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:28:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.879s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:28:23 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f81826-337f-4f70-bfa0-787e3ecadc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef41d901-3272-4020-bd95-d2e98277fbd8', 'volume_size': 1, 'snapshot_id': 'cf7b4bba-1694-4046-8c31-a185dcd95a40'}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:28:23 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f8f11eb-8b99-4f98-972e-9659748bd09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:28:23 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Volume volume-ef41d901-3272-4020-bd95-d2e98277fbd8 (ef41d901-3272-4020-bd95-d2e98277fbd8): created successfully Sep 01 08:28:23 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f8f11eb-8b99-4f98-972e-9659748bd09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:28:23 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Flow 'volume_create_manager' (54db7298-8038-4164-94b0-e664a05f8ddb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:28:23 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-bc29e7ef-6caa-40a4-b3c0-70b444175966 tempest-TestStampPattern-1916184424 None] Created volume successfully. Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] Flow 'volume_create_manager' (ce20aa75-bf69-4435-bfdf-d08f404f38d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e44665-bb1a-44fe-8848-507ccecd4851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e44665-bb1a-44fe-8848-507ccecd4851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1946892192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de923cd2-8482-4c77-bc21-56f95ee0e43c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a8c72ffaeb42b7a7cf0b01ec5b0a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:28:30Z,use_quota=True,user_id='e695aa2c0baf49dab222c4ffde8c55f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81591a06-8614-4021-8638-3ba4931bb9d6),volume_type_id=81591a06-8614-4021-8638-3ba4931bb9d6)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8301abb-897d-4534-b646-d08a1481b59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8301abb-897d-4534-b646-d08a1481b59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ece005a-d764-4d2d-b14f-c875ef31f96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ece005a-d764-4d2d-b14f-c875ef31f96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de923cd2-8482-4c77-bc21-56f95ee0e43c', 'volume_name': 'volume-de923cd2-8482-4c77-bc21-56f95ee0e43c', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e57b493-9f0f-433e-97e6-f02b31eb996a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e57b493-9f0f-433e-97e6-f02b31eb996a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd04d3a5-3aa2-4579-9b19-7657e3663f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:28:30 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] Volume de923cd2-8482-4c77-bc21-56f95ee0e43c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de923cd2-8482-4c77-bc21-56f95ee0e43c', 'volume_size': 1} Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1946892192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de923cd2-8482-4c77-bc21-56f95ee0e43c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a8c72ffaeb42b7a7cf0b01ec5b0a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:28:30Z,use_quota=True,user_id='e695aa2c0baf49dab222c4ffde8c55f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81591a06-8614-4021-8638-3ba4931bb9d6),volume_type_id=81591a06-8614-4021-8638-3ba4931bb9d6)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] Creating volume de923cd2-8482-4c77-bc21-56f95ee0e43c {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:28:30 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-de923cd2-8482-4c77-bc21-56f95ee0e43c 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:28:30 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-de923cd2-8482-4c77-bc21-56f95ee0e43c 1073741824 Sep 01 08:28:30 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] Flow 'volume_create_manager' (a5d1f288-7325-4f42-aed0-9dd6c1b55d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0574e5f3-b524-4306-ac0b-a8659115d3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0574e5f3-b524-4306-ac0b-a8659115d3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1908476012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b86edbd-afe2-4a3a-952c-35a072fea6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a8c72ffaeb42b7a7cf0b01ec5b0a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:28:31Z,use_quota=True,user_id='e695aa2c0baf49dab222c4ffde8c55f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ac5e395-3572-49fc-83c9-d13e339dddf0),volume_type_id=0ac5e395-3572-49fc-83c9-d13e339dddf0)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22044cab-dd2c-47a6-bde3-795cc217c09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22044cab-dd2c-47a6-bde3-795cc217c09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d489b9b5-6b6f-41b7-808f-8456058cc1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d489b9b5-6b6f-41b7-808f-8456058cc1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b86edbd-afe2-4a3a-952c-35a072fea6a8', 'volume_name': 'volume-9b86edbd-afe2-4a3a-952c-35a072fea6a8', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06016d6b-e65b-4171-8de0-c7ecf322d8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06016d6b-e65b-4171-8de0-c7ecf322d8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41290f15-084d-4f6c-b069-fdb0504ce21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:28:30 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] Volume 9b86edbd-afe2-4a3a-952c-35a072fea6a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b86edbd-afe2-4a3a-952c-35a072fea6a8', 'volume_size': 1} Sep 01 08:28:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:28:31 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-de923cd2-8482-4c77-bc21-56f95ee0e43c 1073741824" returned: 0 in 0.840s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.051s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-de923cd2-8482-4c77-bc21-56f95ee0e43c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:28:31 devstack sudo[101859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:28:31 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:28:31 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-de923cd2-8482-4c77-bc21-56f95ee0e43c Sep 01 08:28:31 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:28:31 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.427s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager._thread_info {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread count: 28 {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread info: [<_MainThread(MainThread, started 138934582050944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 08:28:31 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-de923cd2-8482-4c77-bc21-56f95ee0e43c" returned: 0 in 0.467s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.752s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1908476012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b86edbd-afe2-4a3a-952c-35a072fea6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a8c72ffaeb42b7a7cf0b01ec5b0a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:28:31Z,use_quota=True,user_id='e695aa2c0baf49dab222c4ffde8c55f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ac5e395-3572-49fc-83c9-d13e339dddf0),volume_type_id=0ac5e395-3572-49fc-83c9-d13e339dddf0)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] Creating volume 9b86edbd-afe2-4a3a-952c-35a072fea6a8 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:28:31 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9b86edbd-afe2-4a3a-952c-35a072fea6a8 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd04d3a5-3aa2-4579-9b19-7657e3663f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de923cd2-8482-4c77-bc21-56f95ee0e43c', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdeeaaa9-bf55-4327-b298-3254581d5fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:28:31 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] Volume volume-de923cd2-8482-4c77-bc21-56f95ee0e43c (de923cd2-8482-4c77-bc21-56f95ee0e43c): created successfully Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdeeaaa9-bf55-4327-b298-3254581d5fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:28:31 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9b86edbd-afe2-4a3a-952c-35a072fea6a8 1073741824 Sep 01 08:28:31 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] Flow 'volume_create_manager' (ce20aa75-bf69-4435-bfdf-d08f404f38d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:28:31 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-8508265b-029a-4e2b-a473-de7d48b0150e tempest-TestInstancesWithCinderVolumes-544510126 None] Created volume successfully. Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Flow 'volume_create_manager' (133afe6d-0c5a-4746-9c9a-e5118b0c08a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (969d29ac-f29e-48e6-8b5d-ceec7745791e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (969d29ac-f29e-48e6-8b5d-ceec7745791e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1350553511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b80206-a3b1-4ed8-8e76-01f13f54dc90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a8c72ffaeb42b7a7cf0b01ec5b0a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:28:32Z,use_quota=True,user_id='e695aa2c0baf49dab222c4ffde8c55f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efd7e0f1-b87b-4561-b2a0-38a31acf4bbd),volume_type_id=efd7e0f1-b87b-4561-b2a0-38a31acf4bbd)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc4d901-597f-46fb-b884-07254e25a3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc4d901-597f-46fb-b884-07254e25a3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97a01e5-c65a-4d7a-87a0-d984d080cd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:28:31 devstack cinder-volume[86893]: DEBUG cinder.image.glance [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Creating Keystone auth plugin from conf {{(pid=86893) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 08:28:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97a01e5-c65a-4d7a-87a0-d984d080cd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '43b80206-a3b1-4ed8-8e76-01f13f54dc90', 'volume_name': 'volume-43b80206-a3b1-4ed8-8e76-01f13f54dc90', 'volume_size': 1, 'image_id': '3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--673226699', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a9a8c72ffaeb42b7a7cf0b01ec5b0a01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1', 'created_at': datetime.datetime(2026, 9, 1, 6, 28, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 6, 28, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1/file', 'properties': {}}, 'image_service': }' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:28:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf7b92d-da2e-4c77-9d9e-d449c5d440b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:28:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf7b92d-da2e-4c77-9d9e-d449c5d440b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:28:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67578962-6f04-4b44-8e63-8c3be819303c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:28:32 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Volume 43b80206-a3b1-4ed8-8e76-01f13f54dc90: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-43b80206-a3b1-4ed8-8e76-01f13f54dc90', 'volume_size': 1, 'image_id': '3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--673226699', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a9a8c72ffaeb42b7a7cf0b01ec5b0a01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1', 'created_at': datetime.datetime(2026, 9, 1, 6, 28, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 6, 28, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1/file', 'properties': {}}, 'image_service': } Sep 01 08:28:32 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Trying to clone 43b80206-a3b1-4ed8-8e76-01f13f54dc90 from image 3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1', 'metadata': {}}]). {{(pid=86893) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1100}} Sep 01 08:28:32 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Sep 01 08:28:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9b86edbd-afe2-4a3a-952c-35a072fea6a8 1073741824" returned: 0 in 0.649s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:28:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9b86edbd-afe2-4a3a-952c-35a072fea6a8 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:28:32 devstack sudo[101872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9b86edbd-afe2-4a3a-952c-35a072fea6a8 Sep 01 08:28:32 devstack sudo[101872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:28:32 devstack sudo[101872]: pam_unix(sudo:session): session closed for user root Sep 01 08:28:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9b86edbd-afe2-4a3a-952c-35a072fea6a8" returned: 0 in 0.430s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:28:32 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:28:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:28:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41290f15-084d-4f6c-b069-fdb0504ce21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b86edbd-afe2-4a3a-952c-35a072fea6a8', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:28:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d735b693-be80-4af4-8c3a-a5b5e3a9fcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:28:32 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] Volume volume-9b86edbd-afe2-4a3a-952c-35a072fea6a8 (9b86edbd-afe2-4a3a-952c-35a072fea6a8): created successfully Sep 01 08:28:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d735b693-be80-4af4-8c3a-a5b5e3a9fcaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:28:32 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] Flow 'volume_create_manager' (a5d1f288-7325-4f42-aed0-9dd6c1b55d13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:28:32 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-b1f4d539-f1bc-4a09-82b8-bbc8d19068e2 tempest-TestInstancesWithCinderVolumes-544510126 None] Created volume successfully. Sep 01 08:28:35 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1_f3zzxrhndevstack@QuobyteHD, size 20.69 MB, duration 3.21 sec {{(pid=86893) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 08:28:35 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Image download 20.69 MB at 6.45 MB/s Sep 01 08:28:35 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c8029c-38ea-472f-979b-6021cbb5d0cb]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:28:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1_f3zzxrhndevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:28:35 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1_f3zzxrhndevstack@QuobyteHD Sep 01 08:28:35 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:28:35 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Sep 01 08:28:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1_f3zzxrhndevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:28:35 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Temporary image 3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1 is fetched for user e695aa2c0baf49dab222c4ffde8c55f6. {{(pid=86893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 08:28:35 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c72ad0-0e8c-4c83-b6c3-e1697b00b2a7]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:28:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1_f3zzxrhndevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:28:36 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1_f3zzxrhndevstack@QuobyteHD Sep 01 08:28:36 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:28:36 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Sep 01 08:28:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1_f3zzxrhndevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:28:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:28:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:28:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1350553511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b80206-a3b1-4ed8-8e76-01f13f54dc90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a8c72ffaeb42b7a7cf0b01ec5b0a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:28:32Z,use_quota=True,user_id='e695aa2c0baf49dab222c4ffde8c55f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efd7e0f1-b87b-4561-b2a0-38a31acf4bbd),volume_type_id=efd7e0f1-b87b-4561-b2a0-38a31acf4bbd)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:28:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Creating volume 43b80206-a3b1-4ed8-8e76-01f13f54dc90 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:28:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:28:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:28:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:28:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:28:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:28:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:28:36 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:28:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-43b80206-a3b1-4ed8-8e76-01f13f54dc90 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:28:36 devstack sudo[101885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-43b80206-a3b1-4ed8-8e76-01f13f54dc90 1073741824 Sep 01 08:28:36 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:28:36 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root Sep 01 08:28:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-43b80206-a3b1-4ed8-8e76-01f13f54dc90 1073741824" returned: 0 in 0.414s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:28:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-43b80206-a3b1-4ed8-8e76-01f13f54dc90 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:28:36 devstack sudo[101890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-43b80206-a3b1-4ed8-8e76-01f13f54dc90 Sep 01 08:28:36 devstack sudo[101890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:28:37 devstack sudo[101890]: pam_unix(sudo:session): session closed for user root Sep 01 08:28:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-43b80206-a3b1-4ed8-8e76-01f13f54dc90" returned: 0 in 0.263s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:28:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:28:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:28:37 devstack cinder-volume[86893]: DEBUG cinder.volume.volume_utils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Attempting download of 3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1 ((None, [{'url': 'file:///opt/stack/data/glance/images/3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1', 'metadata': {}}])) to volume 43b80206-a3b1-4ed8-8e76-01f13f54dc90. {{(pid=86893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 08:28:37 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[45533f7d-a117-4e6d-aa41-61b7fde94a66]: (4, 'raw') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:28:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1_5_n3xt8z {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:28:37 devstack sudo[101893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1_5_n3xt8z Sep 01 08:28:37 devstack sudo[101893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:28:37 devstack sudo[101893]: pam_unix(sudo:session): session closed for user root Sep 01 08:28:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1_5_n3xt8z" returned: 0 in 0.333s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:28:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1_5_n3xt8z {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:28:37 devstack sudo[101898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1_5_n3xt8z Sep 01 08:28:37 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:28:37 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root Sep 01 08:28:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1_5_n3xt8z" returned: 1 in 0.326s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:28:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1_5_n3xt8z' failed. Not Retrying. {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 08:28:37 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7f1ca2-7b86-4c3a-b9af-3223c888c94a]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:28:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1_f3zzxrhndevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:28:37 devstack sudo[101902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1_f3zzxrhndevstack@QuobyteHD Sep 01 08:28:37 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:28:38 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root Sep 01 08:28:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1_f3zzxrhndevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:28:38 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] 3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1 was qcow2, converting to qcow2 {{(pid=86893) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 08:28:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1_f3zzxrhndevstack@QuobyteHD /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-43b80206-a3b1-4ed8-8e76-01f13f54dc90 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:28:38 devstack sudo[101907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1_f3zzxrhndevstack@QuobyteHD /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-43b80206-a3b1-4ed8-8e76-01f13f54dc90 Sep 01 08:28:38 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:28:39 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root Sep 01 08:28:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1_f3zzxrhndevstack@QuobyteHD /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-43b80206-a3b1-4ed8-8e76-01f13f54dc90" returned: 0 in 1.625s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:28:39 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1_f3zzxrhndevstack@QuobyteHD, size 112.00 MB, duration 1.63 sec, destination /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-43b80206-a3b1-4ed8-8e76-01f13f54dc90 {{(pid=86893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 08:28:39 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Converted 112.00 MB image at 68.86 MB/s Sep 01 08:28:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-43b80206-a3b1-4ed8-8e76-01f13f54dc90 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:28:39 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-43b80206-a3b1-4ed8-8e76-01f13f54dc90 1G Sep 01 08:28:39 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:28:40 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Sep 01 08:28:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-43b80206-a3b1-4ed8-8e76-01f13f54dc90 1G" returned: 0 in 0.313s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:28:40 devstack cinder-volume[86893]: DEBUG cinder.volume.volume_utils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Downloaded image 3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1 ((None, [{'url': 'file:///opt/stack/data/glance/images/3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1', 'metadata': {}}])) to volume 43b80206-a3b1-4ed8-8e76-01f13f54dc90 successfully. {{(pid=86893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 08:28:40 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Temporary image 3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1 for user e695aa2c0baf49dab222c4ffde8c55f6 is deleted. {{(pid=86893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 08:28:40 devstack cinder-volume[86893]: DEBUG cinder.volume.volume_utils [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Marking volume 43b80206-a3b1-4ed8-8e76-01f13f54dc90 as bootable. {{(pid=86893) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 08:28:40 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Copying metadata from image 3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1 to 43b80206-a3b1-4ed8-8e76-01f13f54dc90. {{(pid=86893) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 08:28:40 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Creating volume glance metadata for volume 43b80206-a3b1-4ed8-8e76-01f13f54dc90 backed by image 3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1 with: {'image_id': '3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1', 'image_name': 'tempest-scenario-img--673226699', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86893) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 08:28:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67578962-6f04-4b44-8e63-8c3be819303c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43b80206-a3b1-4ed8-8e76-01f13f54dc90', 'volume_size': 1, 'image_id': '3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--673226699', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a9a8c72ffaeb42b7a7cf0b01ec5b0a01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1', 'created_at': datetime.datetime(2026, 9, 1, 6, 28, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 6, 28, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3cdec592-1d3b-4a7d-ad35-d4d4eafc5ac1/file', 'properties': {}}, 'image_service': }' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:28:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006c4d0a-caae-4754-bb8e-4bfb9f3b2082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:28:40 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Volume volume-43b80206-a3b1-4ed8-8e76-01f13f54dc90 (43b80206-a3b1-4ed8-8e76-01f13f54dc90): created successfully Sep 01 08:28:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006c4d0a-caae-4754-bb8e-4bfb9f3b2082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:28:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Flow 'volume_create_manager' (133afe6d-0c5a-4746-9c9a-e5118b0c08a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:28:40 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-d321919d-3be8-49d1-9370-8332b2b09b63 tempest-TestInstancesWithCinderVolumes-544510126 None] Created volume successfully. Sep 01 08:28:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-ab6f9c9f-12d7-4084-8b1d-dc2cf792aebc req-14ee3069-d5fe-441d-a1ba-0d69e1215e62 tempest-TestInstancesWithCinderVolumes-544510126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:28:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-ab6f9c9f-12d7-4084-8b1d-dc2cf792aebc req-14ee3069-d5fe-441d-a1ba-0d69e1215e62 tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:28:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-ab6f9c9f-12d7-4084-8b1d-dc2cf792aebc req-14ee3069-d5fe-441d-a1ba-0d69e1215e62 tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:28:43 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-ab6f9c9f-12d7-4084-8b1d-dc2cf792aebc req-14ee3069-d5fe-441d-a1ba-0d69e1215e62 tempest-TestInstancesWithCinderVolumes-544510126 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049', 'name': 'volume-43b80206-a3b1-4ed8-8e76-01f13f54dc90', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f60c96e4-304d-46be-b5e9-4ad88f211a47', 'enforce_multipath': True} {{(pid=86893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 08:28:43 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-ab6f9c9f-12d7-4084-8b1d-dc2cf792aebc req-14ee3069-d5fe-441d-a1ba-0d69e1215e62 tempest-TestInstancesWithCinderVolumes-544510126 None] attachment_update completed successfully. Sep 01 08:28:53 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=44,cinder:INSERT=7,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:28:53 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=32,cinder:UPDATE=29,cinder:INSERT=11,cinder:DELETE=5 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:29:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-cbf60c48-b389-47ea-a358-0dfef9022236 req-838fea09-27bf-4324-9621-1abe5d13dc10 tempest-TestStampPattern-1916184424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:29:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-cbf60c48-b389-47ea-a358-0dfef9022236 req-838fea09-27bf-4324-9621-1abe5d13dc10 tempest-TestStampPattern-1916184424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:29:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-cbf60c48-b389-47ea-a358-0dfef9022236 req-838fea09-27bf-4324-9621-1abe5d13dc10 tempest-TestStampPattern-1916184424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:29:08 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-cbf60c48-b389-47ea-a358-0dfef9022236 req-838fea09-27bf-4324-9621-1abe5d13dc10 tempest-TestStampPattern-1916184424 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049', 'name': 'volume-ef41d901-3272-4020-bd95-d2e98277fbd8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3dac54dc-77fa-4bcc-a7a9-e83359c3c3a4', 'enforce_multipath': True} {{(pid=86893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 08:29:08 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-cbf60c48-b389-47ea-a358-0dfef9022236 req-838fea09-27bf-4324-9621-1abe5d13dc10 tempest-TestStampPattern-1916184424 None] attachment_update completed successfully. Sep 01 08:29:11 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-899e1963-2de0-4df1-bed5-1272010cbc7d req-139335ae-faf1-4a4f-a64c-6809399e2244 tempest-TestStampPattern-1916184424 None] Terminate volume connection completed successfully. Sep 01 08:29:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-899e1963-2de0-4df1-bed5-1272010cbc7d req-139335ae-faf1-4a4f-a64c-6809399e2244 tempest-TestStampPattern-1916184424 None] Deleting attachment 3dac54dc-77fa-4bcc-a7a9-e83359c3c3a4. {{(pid=86893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 08:29:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-0d2a164f-7605-4a8a-82b1-184a3266c7e0 req-bcb30726-b6e5-4d4a-b3f3-7d99dacb93c9 tempest-TestInstancesWithCinderVolumes-544510126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:29:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-0d2a164f-7605-4a8a-82b1-184a3266c7e0 req-bcb30726-b6e5-4d4a-b3f3-7d99dacb93c9 tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:29:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-0d2a164f-7605-4a8a-82b1-184a3266c7e0 req-bcb30726-b6e5-4d4a-b3f3-7d99dacb93c9 tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:29:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-0d2a164f-7605-4a8a-82b1-184a3266c7e0 req-bcb30726-b6e5-4d4a-b3f3-7d99dacb93c9 tempest-TestInstancesWithCinderVolumes-544510126 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049', 'name': 'volume-de923cd2-8482-4c77-bc21-56f95ee0e43c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a7fd7a9-0447-4cf8-adcc-e74ebe40effe', 'enforce_multipath': True} {{(pid=86893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 08:29:14 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-0d2a164f-7605-4a8a-82b1-184a3266c7e0 req-bcb30726-b6e5-4d4a-b3f3-7d99dacb93c9 tempest-TestInstancesWithCinderVolumes-544510126 None] attachment_update completed successfully. Sep 01 08:29:15 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-939b4a05-2800-451f-b6b8-a7a4394d6056 tempest-TestStampPattern-1916184424 None] Acquiring lock "cinder-ef41d901-3272-4020-bd95-d2e98277fbd8-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:29:15 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-939b4a05-2800-451f-b6b8-a7a4394d6056 tempest-TestStampPattern-1916184424 None] Lock "cinder-ef41d901-3272-4020-bd95-d2e98277fbd8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:29:15 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-939b4a05-2800-451f-b6b8-a7a4394d6056 tempest-TestStampPattern-1916184424 None] Acquiring lock "cinder-quobyte-ef41d901-3272-4020-bd95-d2e98277fbd8" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:29:15 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-939b4a05-2800-451f-b6b8-a7a4394d6056 tempest-TestStampPattern-1916184424 None] Lock "cinder-quobyte-ef41d901-3272-4020-bd95-d2e98277fbd8" acquired by "delete_volume" :: waited 0.015s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:29:15 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2374a9-d0db-411e-8e49-183bbb2cf910]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:29:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-939b4a05-2800-451f-b6b8-a7a4394d6056 tempest-TestStampPattern-1916184424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef41d901-3272-4020-bd95-d2e98277fbd8 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:15 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef41d901-3272-4020-bd95-d2e98277fbd8 Sep 01 08:29:15 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:15 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-939b4a05-2800-451f-b6b8-a7a4394d6056 tempest-TestStampPattern-1916184424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef41d901-3272-4020-bd95-d2e98277fbd8" returned: 0 in 0.362s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-939b4a05-2800-451f-b6b8-a7a4394d6056 tempest-TestStampPattern-1916184424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef41d901-3272-4020-bd95-d2e98277fbd8 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:15 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef41d901-3272-4020-bd95-d2e98277fbd8 Sep 01 08:29:15 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:15 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-939b4a05-2800-451f-b6b8-a7a4394d6056 tempest-TestStampPattern-1916184424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef41d901-3272-4020-bd95-d2e98277fbd8" returned: 0 in 0.256s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:16 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-939b4a05-2800-451f-b6b8-a7a4394d6056 tempest-TestStampPattern-1916184424 None] Lock "cinder-quobyte-ef41d901-3272-4020-bd95-d2e98277fbd8" released by "delete_volume" :: held 0.666s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:29:16 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-939b4a05-2800-451f-b6b8-a7a4394d6056 tempest-TestStampPattern-1916184424 None] Created reservations ['8d15118d-9ea0-485a-9c10-2dc0ddc5b29b', '087d8087-f555-496f-b32c-3861bdce9c53', 'e236411c-4250-4964-919a-0cfece58bb89', 'f3e3eb2a-a510-41fb-b260-b3c90b442338'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:29:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-939b4a05-2800-451f-b6b8-a7a4394d6056 tempest-TestStampPattern-1916184424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:29:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-939b4a05-2800-451f-b6b8-a7a4394d6056 tempest-TestStampPattern-1916184424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:29:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-939b4a05-2800-451f-b6b8-a7a4394d6056 tempest-TestStampPattern-1916184424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:29:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-939b4a05-2800-451f-b6b8-a7a4394d6056 tempest-TestStampPattern-1916184424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:29:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-939b4a05-2800-451f-b6b8-a7a4394d6056 tempest-TestStampPattern-1916184424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:29:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-939b4a05-2800-451f-b6b8-a7a4394d6056 tempest-TestStampPattern-1916184424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:16 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:29:16 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:16 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-939b4a05-2800-451f-b6b8-a7a4394d6056 tempest-TestStampPattern-1916184424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.283s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:16 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-939b4a05-2800-451f-b6b8-a7a4394d6056 tempest-TestStampPattern-1916184424 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:29:16 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-939b4a05-2800-451f-b6b8-a7a4394d6056 tempest-TestStampPattern-1916184424 None] Deleted volume successfully. Sep 01 08:29:16 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-939b4a05-2800-451f-b6b8-a7a4394d6056 tempest-TestStampPattern-1916184424 None] Lock "cinder-ef41d901-3272-4020-bd95-d2e98277fbd8-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:29:16 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7a3b4de2-288d-4e68-ae06-c56c97b4e747 tempest-TestStampPattern-1916184424 None] Acquiring lock "cinder-cf7b4bba-1694-4046-8c31-a185dcd95a40-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:29:16 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7a3b4de2-288d-4e68-ae06-c56c97b4e747 tempest-TestStampPattern-1916184424 None] Lock "cinder-cf7b4bba-1694-4046-8c31-a185dcd95a40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:29:16 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7a3b4de2-288d-4e68-ae06-c56c97b4e747 tempest-TestStampPattern-1916184424 None] Acquiring lock "cinder-quobyte-a0e0e579-91d7-440d-9557-7c9649b27a78" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:29:16 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7a3b4de2-288d-4e68-ae06-c56c97b4e747 tempest-TestStampPattern-1916184424 None] Lock "cinder-quobyte-a0e0e579-91d7-440d-9557-7c9649b27a78" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:29:16 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7a3b4de2-288d-4e68-ae06-c56c97b4e747 tempest-TestStampPattern-1916184424 None] Acquiring lock "cinder-quobyte-cf7b4bba-1694-4046-8c31-a185dcd95a40" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:29:16 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7a3b4de2-288d-4e68-ae06-c56c97b4e747 tempest-TestStampPattern-1916184424 None] Lock "cinder-quobyte-cf7b4bba-1694-4046-8c31-a185dcd95a40" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:29:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-7a3b4de2-288d-4e68-ae06-c56c97b4e747 tempest-TestStampPattern-1916184424 None] Deleting offline snapshot cf7b4bba-1694-4046-8c31-a185dcd95a40 of volume a0e0e579-91d7-440d-9557-7c9649b27a78 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:29:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-7a3b4de2-288d-4e68-ae06-c56c97b4e747 tempest-TestStampPattern-1916184424 None] snapshot_file for this snap is: volume-a0e0e579-91d7-440d-9557-7c9649b27a78.cf7b4bba-1694-4046-8c31-a185dcd95a40 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:29:16 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a435f5a-1874-4918-a28a-a270b0e30719]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:29:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7a3b4de2-288d-4e68-ae06-c56c97b4e747 tempest-TestStampPattern-1916184424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78.cf7b4bba-1694-4046-8c31-a185dcd95a40 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-7800bafd-5c79-4484-ae8c-582e7eac48c6 req-b9294e57-4e6f-408e-9d90-dbaabb32eb8b tempest-TestInstancesWithCinderVolumes-544510126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:29:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-7800bafd-5c79-4484-ae8c-582e7eac48c6 req-b9294e57-4e6f-408e-9d90-dbaabb32eb8b tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:29:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-7800bafd-5c79-4484-ae8c-582e7eac48c6 req-b9294e57-4e6f-408e-9d90-dbaabb32eb8b tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:29:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-7800bafd-5c79-4484-ae8c-582e7eac48c6 req-b9294e57-4e6f-408e-9d90-dbaabb32eb8b tempest-TestInstancesWithCinderVolumes-544510126 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049', 'name': 'volume-9b86edbd-afe2-4a3a-952c-35a072fea6a8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a43237cb-2e83-42d0-91b8-cdc84b5cd2f3', 'enforce_multipath': True} {{(pid=86893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 08:29:16 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78.cf7b4bba-1694-4046-8c31-a185dcd95a40 Sep 01 08:29:16 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:17 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-7800bafd-5c79-4484-ae8c-582e7eac48c6 req-b9294e57-4e6f-408e-9d90-dbaabb32eb8b tempest-TestInstancesWithCinderVolumes-544510126 None] attachment_update completed successfully. Sep 01 08:29:17 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7a3b4de2-288d-4e68-ae06-c56c97b4e747 tempest-TestStampPattern-1916184424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78.cf7b4bba-1694-4046-8c31-a185dcd95a40" returned: 0 in 0.399s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:17 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-7a3b4de2-288d-4e68-ae06-c56c97b4e747 tempest-TestStampPattern-1916184424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0e0e579-91d7-440d-9557-7c9649b27a78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:29:17 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[61824b1d-d728-4cac-bd80-4eac8d8a4ac1]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:29:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7a3b4de2-288d-4e68-ae06-c56c97b4e747 tempest-TestStampPattern-1916184424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:17 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78 Sep 01 08:29:17 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:17 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7a3b4de2-288d-4e68-ae06-c56c97b4e747 tempest-TestStampPattern-1916184424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78" returned: 0 in 0.567s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7a3b4de2-288d-4e68-ae06-c56c97b4e747 tempest-TestStampPattern-1916184424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78.cf7b4bba-1694-4046-8c31-a185dcd95a40 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:17 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78.cf7b4bba-1694-4046-8c31-a185dcd95a40 Sep 01 08:29:17 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:18 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7a3b4de2-288d-4e68-ae06-c56c97b4e747 tempest-TestStampPattern-1916184424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78.cf7b4bba-1694-4046-8c31-a185dcd95a40" returned: 0 in 0.346s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7a3b4de2-288d-4e68-ae06-c56c97b4e747 tempest-TestStampPattern-1916184424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78.cf7b4bba-1694-4046-8c31-a185dcd95a40 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:18 devstack sudo[102621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78.cf7b4bba-1694-4046-8c31-a185dcd95a40 Sep 01 08:29:18 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:18 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7a3b4de2-288d-4e68-ae06-c56c97b4e747 tempest-TestStampPattern-1916184424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78.cf7b4bba-1694-4046-8c31-a185dcd95a40" returned: 0 in 0.266s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:18 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7a3b4de2-288d-4e68-ae06-c56c97b4e747 tempest-TestStampPattern-1916184424 None] Lock "cinder-quobyte-cf7b4bba-1694-4046-8c31-a185dcd95a40" released by "_delete_snapshot" :: held 1.685s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:29:18 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7a3b4de2-288d-4e68-ae06-c56c97b4e747 tempest-TestStampPattern-1916184424 None] Lock "cinder-quobyte-a0e0e579-91d7-440d-9557-7c9649b27a78" released by "delete_snapshot" :: held 1.709s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:29:18 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-7a3b4de2-288d-4e68-ae06-c56c97b4e747 tempest-TestStampPattern-1916184424 None] Created reservations ['f637de18-fdb5-441c-a0b4-890e2437ef66', '9eeaab4d-69dc-41e4-b636-d033dd2d713f', '27f1bb79-5b6d-4bcc-ab3d-5d7d9e2f36ed', '91717dad-999b-4ab4-8f3c-1cca89e262f5'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:29:18 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-7a3b4de2-288d-4e68-ae06-c56c97b4e747 tempest-TestStampPattern-1916184424 None] Delete snapshot completed successfully. Sep 01 08:29:18 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7a3b4de2-288d-4e68-ae06-c56c97b4e747 tempest-TestStampPattern-1916184424 None] Lock "cinder-cf7b4bba-1694-4046-8c31-a185dcd95a40-delete_snapshot" released by "delete_snapshot" :: held 1.867s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:29:21 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-7ac2d6f5-cbb8-40c3-ad98-05a104c304c1 req-f6320193-6a6a-451a-88b4-81821f1722f6 tempest-TestInstancesWithCinderVolumes-544510126 None] Terminate volume connection completed successfully. Sep 01 08:29:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-7ac2d6f5-cbb8-40c3-ad98-05a104c304c1 req-f6320193-6a6a-451a-88b4-81821f1722f6 tempest-TestInstancesWithCinderVolumes-544510126 None] Deleting attachment 3a7fd7a9-0447-4cf8-adcc-e74ebe40effe. {{(pid=86893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 08:29:22 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-aa693576-9bbc-4ecc-aae1-35003d04f488 tempest-TestInstancesWithCinderVolumes-544510126 None] Acquiring lock "cinder-de923cd2-8482-4c77-bc21-56f95ee0e43c-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:29:22 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-aa693576-9bbc-4ecc-aae1-35003d04f488 tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "cinder-de923cd2-8482-4c77-bc21-56f95ee0e43c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:29:22 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-aa693576-9bbc-4ecc-aae1-35003d04f488 tempest-TestInstancesWithCinderVolumes-544510126 None] Acquiring lock "cinder-quobyte-de923cd2-8482-4c77-bc21-56f95ee0e43c" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:29:22 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-aa693576-9bbc-4ecc-aae1-35003d04f488 tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "cinder-quobyte-de923cd2-8482-4c77-bc21-56f95ee0e43c" acquired by "delete_volume" :: waited 0.014s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:29:22 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f157ec-d31e-4d07-af38-b47a017a8b8e]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:29:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-aa693576-9bbc-4ecc-aae1-35003d04f488 tempest-TestInstancesWithCinderVolumes-544510126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-de923cd2-8482-4c77-bc21-56f95ee0e43c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:22 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1fcf13f8-1cb8-4842-86f7-962d77badb82 tempest-TestStampPattern-1916184424 None] Acquiring lock "cinder-a0e0e579-91d7-440d-9557-7c9649b27a78-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:29:22 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1fcf13f8-1cb8-4842-86f7-962d77badb82 tempest-TestStampPattern-1916184424 None] Lock "cinder-a0e0e579-91d7-440d-9557-7c9649b27a78-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:29:22 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-de923cd2-8482-4c77-bc21-56f95ee0e43c Sep 01 08:29:22 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:22 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1fcf13f8-1cb8-4842-86f7-962d77badb82 tempest-TestStampPattern-1916184424 None] Acquiring lock "cinder-quobyte-a0e0e579-91d7-440d-9557-7c9649b27a78" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:29:22 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1fcf13f8-1cb8-4842-86f7-962d77badb82 tempest-TestStampPattern-1916184424 None] Lock "cinder-quobyte-a0e0e579-91d7-440d-9557-7c9649b27a78" acquired by "delete_volume" :: waited 0.024s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:29:22 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e971963-dce9-47fd-8a01-7203f8e366a3]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:29:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1fcf13f8-1cb8-4842-86f7-962d77badb82 tempest-TestStampPattern-1916184424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:22 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78 Sep 01 08:29:22 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:23 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-aa693576-9bbc-4ecc-aae1-35003d04f488 tempest-TestInstancesWithCinderVolumes-544510126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-de923cd2-8482-4c77-bc21-56f95ee0e43c" returned: 0 in 0.462s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-aa693576-9bbc-4ecc-aae1-35003d04f488 tempest-TestInstancesWithCinderVolumes-544510126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-de923cd2-8482-4c77-bc21-56f95ee0e43c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:23 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-de923cd2-8482-4c77-bc21-56f95ee0e43c Sep 01 08:29:23 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:23 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1fcf13f8-1cb8-4842-86f7-962d77badb82 tempest-TestStampPattern-1916184424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78" returned: 0 in 0.416s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1fcf13f8-1cb8-4842-86f7-962d77badb82 tempest-TestStampPattern-1916184424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:23 devstack sudo[102693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78 Sep 01 08:29:23 devstack sudo[102693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:23 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-aa693576-9bbc-4ecc-aae1-35003d04f488 tempest-TestInstancesWithCinderVolumes-544510126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-de923cd2-8482-4c77-bc21-56f95ee0e43c" returned: 0 in 0.291s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:23 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-aa693576-9bbc-4ecc-aae1-35003d04f488 tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "cinder-quobyte-de923cd2-8482-4c77-bc21-56f95ee0e43c" released by "delete_volume" :: held 0.811s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:29:23 devstack cinder-volume[86893]: WARNING cinder.quota [None req-aa693576-9bbc-4ecc-aae1-35003d04f488 tempest-TestInstancesWithCinderVolumes-544510126 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1220064238-1908261263 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1220064238-1908261263, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:29:23 devstack cinder-volume[86893]: WARNING cinder.quota [None req-aa693576-9bbc-4ecc-aae1-35003d04f488 tempest-TestInstancesWithCinderVolumes-544510126 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1220064238-1908261263 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1220064238-1908261263, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:29:23 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-aa693576-9bbc-4ecc-aae1-35003d04f488 tempest-TestInstancesWithCinderVolumes-544510126 None] Created reservations ['76fcc6c8-e621-46de-ae12-e82a92fc758e', '3566a56b-ea14-4b42-9cf1-2bac80a7bae6', '6c2fd734-49ac-48f0-9e72-e7e06ce0c94b', '58c39657-be47-40c1-b44a-f5a46f4e4352'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:29:23 devstack sudo[102693]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-aa693576-9bbc-4ecc-aae1-35003d04f488 tempest-TestInstancesWithCinderVolumes-544510126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:29:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-aa693576-9bbc-4ecc-aae1-35003d04f488 tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:29:23 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-aa693576-9bbc-4ecc-aae1-35003d04f488 tempest-TestInstancesWithCinderVolumes-544510126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:29:23 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-aa693576-9bbc-4ecc-aae1-35003d04f488 tempest-TestInstancesWithCinderVolumes-544510126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:29:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-aa693576-9bbc-4ecc-aae1-35003d04f488 tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:29:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-aa693576-9bbc-4ecc-aae1-35003d04f488 tempest-TestInstancesWithCinderVolumes-544510126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1fcf13f8-1cb8-4842-86f7-962d77badb82 tempest-TestStampPattern-1916184424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a0e0e579-91d7-440d-9557-7c9649b27a78" returned: 0 in 0.300s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:23 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1fcf13f8-1cb8-4842-86f7-962d77badb82 tempest-TestStampPattern-1916184424 None] Lock "cinder-quobyte-a0e0e579-91d7-440d-9557-7c9649b27a78" released by "delete_volume" :: held 0.780s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:29:23 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:29:23 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:23 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-1fcf13f8-1cb8-4842-86f7-962d77badb82 tempest-TestStampPattern-1916184424 None] Created reservations ['786195b7-5377-4d8c-a797-348bafe06d50', '887ba478-36e2-4750-a007-5651089c2e59', 'c18c2786-1e8e-48d2-aeec-b8c3c2b21cd4', 'b25862b0-06e8-45a2-a599-340624e78a03'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:29:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1fcf13f8-1cb8-4842-86f7-962d77badb82 tempest-TestStampPattern-1916184424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:29:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1fcf13f8-1cb8-4842-86f7-962d77badb82 tempest-TestStampPattern-1916184424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:29:23 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1fcf13f8-1cb8-4842-86f7-962d77badb82 tempest-TestStampPattern-1916184424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:29:23 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1fcf13f8-1cb8-4842-86f7-962d77badb82 tempest-TestStampPattern-1916184424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:29:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1fcf13f8-1cb8-4842-86f7-962d77badb82 tempest-TestStampPattern-1916184424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:29:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1fcf13f8-1cb8-4842-86f7-962d77badb82 tempest-TestStampPattern-1916184424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:23 devstack sudo[102699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:29:23 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:23 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-aa693576-9bbc-4ecc-aae1-35003d04f488 tempest-TestInstancesWithCinderVolumes-544510126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.306s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:23 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-aa693576-9bbc-4ecc-aae1-35003d04f488 tempest-TestInstancesWithCinderVolumes-544510126 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:29:23 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-aa693576-9bbc-4ecc-aae1-35003d04f488 tempest-TestInstancesWithCinderVolumes-544510126 None] Deleted volume successfully. Sep 01 08:29:23 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-aa693576-9bbc-4ecc-aae1-35003d04f488 tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "cinder-de923cd2-8482-4c77-bc21-56f95ee0e43c-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:29:23 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1fcf13f8-1cb8-4842-86f7-962d77badb82 tempest-TestStampPattern-1916184424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.286s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:23 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-1fcf13f8-1cb8-4842-86f7-962d77badb82 tempest-TestStampPattern-1916184424 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:29:23 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-1fcf13f8-1cb8-4842-86f7-962d77badb82 tempest-TestStampPattern-1916184424 None] Deleted volume successfully. Sep 01 08:29:23 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1fcf13f8-1cb8-4842-86f7-962d77badb82 tempest-TestStampPattern-1916184424 None] Lock "cinder-a0e0e579-91d7-440d-9557-7c9649b27a78-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:29:26 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-7dbb5e19-54e2-40dc-932f-857a7e5af79e req-a9cb8143-13e5-4b88-9e81-2f908158b33b tempest-TestInstancesWithCinderVolumes-544510126 None] Terminate volume connection completed successfully. Sep 01 08:29:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-7dbb5e19-54e2-40dc-932f-857a7e5af79e req-a9cb8143-13e5-4b88-9e81-2f908158b33b tempest-TestInstancesWithCinderVolumes-544510126 None] Deleting attachment a43237cb-2e83-42d0-91b8-cdc84b5cd2f3. {{(pid=86893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 08:29:27 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a055d494-b03c-46bf-936c-576e8889cf52 tempest-TestInstancesWithCinderVolumes-544510126 None] Acquiring lock "cinder-9b86edbd-afe2-4a3a-952c-35a072fea6a8-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:29:27 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a055d494-b03c-46bf-936c-576e8889cf52 tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "cinder-9b86edbd-afe2-4a3a-952c-35a072fea6a8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:29:27 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a055d494-b03c-46bf-936c-576e8889cf52 tempest-TestInstancesWithCinderVolumes-544510126 None] Acquiring lock "cinder-quobyte-9b86edbd-afe2-4a3a-952c-35a072fea6a8" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:29:27 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a055d494-b03c-46bf-936c-576e8889cf52 tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "cinder-quobyte-9b86edbd-afe2-4a3a-952c-35a072fea6a8" acquired by "delete_volume" :: waited 0.014s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:29:27 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a3badf-ea37-4d5b-b6f8-7598b9eee1e6]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:29:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a055d494-b03c-46bf-936c-576e8889cf52 tempest-TestInstancesWithCinderVolumes-544510126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9b86edbd-afe2-4a3a-952c-35a072fea6a8 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:27 devstack sudo[102727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9b86edbd-afe2-4a3a-952c-35a072fea6a8 Sep 01 08:29:27 devstack sudo[102727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:27 devstack sudo[102727]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a055d494-b03c-46bf-936c-576e8889cf52 tempest-TestInstancesWithCinderVolumes-544510126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9b86edbd-afe2-4a3a-952c-35a072fea6a8" returned: 0 in 0.400s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a055d494-b03c-46bf-936c-576e8889cf52 tempest-TestInstancesWithCinderVolumes-544510126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9b86edbd-afe2-4a3a-952c-35a072fea6a8 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:27 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9b86edbd-afe2-4a3a-952c-35a072fea6a8 Sep 01 08:29:27 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:27 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a055d494-b03c-46bf-936c-576e8889cf52 tempest-TestInstancesWithCinderVolumes-544510126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9b86edbd-afe2-4a3a-952c-35a072fea6a8" returned: 0 in 0.392s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:27 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a055d494-b03c-46bf-936c-576e8889cf52 tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "cinder-quobyte-9b86edbd-afe2-4a3a-952c-35a072fea6a8" released by "delete_volume" :: held 0.831s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:29:27 devstack cinder-volume[86893]: WARNING cinder.quota [None req-a055d494-b03c-46bf-936c-576e8889cf52 tempest-TestInstancesWithCinderVolumes-544510126 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-39705970-630475383 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-39705970-630475383, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:29:27 devstack cinder-volume[86893]: WARNING cinder.quota [None req-a055d494-b03c-46bf-936c-576e8889cf52 tempest-TestInstancesWithCinderVolumes-544510126 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-39705970-630475383 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-39705970-630475383, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:29:28 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-a055d494-b03c-46bf-936c-576e8889cf52 tempest-TestInstancesWithCinderVolumes-544510126 None] Created reservations ['05d21609-285c-42cf-a631-7e1b1b1d2936', '1e082f54-abff-4f03-be00-4ee09b4b7d6f', '8d32b0ad-7faf-42e8-b2c8-edaab73cbba8', '500503f2-c60f-4717-9440-6d64ed7e7ef4'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:29:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a055d494-b03c-46bf-936c-576e8889cf52 tempest-TestInstancesWithCinderVolumes-544510126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:29:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a055d494-b03c-46bf-936c-576e8889cf52 tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:29:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a055d494-b03c-46bf-936c-576e8889cf52 tempest-TestInstancesWithCinderVolumes-544510126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:29:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a055d494-b03c-46bf-936c-576e8889cf52 tempest-TestInstancesWithCinderVolumes-544510126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:29:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a055d494-b03c-46bf-936c-576e8889cf52 tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:29:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a055d494-b03c-46bf-936c-576e8889cf52 tempest-TestInstancesWithCinderVolumes-544510126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:28 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:29:28 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:28 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a055d494-b03c-46bf-936c-576e8889cf52 tempest-TestInstancesWithCinderVolumes-544510126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.309s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:28 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-a055d494-b03c-46bf-936c-576e8889cf52 tempest-TestInstancesWithCinderVolumes-544510126 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:29:28 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-a055d494-b03c-46bf-936c-576e8889cf52 tempest-TestInstancesWithCinderVolumes-544510126 None] Deleted volume successfully. Sep 01 08:29:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a055d494-b03c-46bf-936c-576e8889cf52 tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "cinder-9b86edbd-afe2-4a3a-952c-35a072fea6a8-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:29:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:29:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:29:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:29:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:29:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:29:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:29:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:31 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:29:31 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:31 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.261s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:31 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:29:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager._thread_info {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:29:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread count: 28 {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 08:29:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread info: [<_MainThread(MainThread, started 138934582050944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 08:29:31 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-4757c2bc-1025-4689-8c72-1ae2e1c01bb5 req-45c04491-5e42-4ca4-bbbb-b7c4e1347a20 tempest-TestInstancesWithCinderVolumes-544510126 None] Terminate volume connection completed successfully. Sep 01 08:29:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-4757c2bc-1025-4689-8c72-1ae2e1c01bb5 req-45c04491-5e42-4ca4-bbbb-b7c4e1347a20 tempest-TestInstancesWithCinderVolumes-544510126 None] Deleting attachment f60c96e4-304d-46be-b5e9-4ad88f211a47. {{(pid=86893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 08:29:32 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1afead37-ab30-437b-b4dd-1f07f745a52e tempest-TestInstancesWithCinderVolumes-544510126 None] Acquiring lock "cinder-43b80206-a3b1-4ed8-8e76-01f13f54dc90-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:29:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1afead37-ab30-437b-b4dd-1f07f745a52e tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "cinder-43b80206-a3b1-4ed8-8e76-01f13f54dc90-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:29:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1afead37-ab30-437b-b4dd-1f07f745a52e tempest-TestInstancesWithCinderVolumes-544510126 None] Acquiring lock "cinder-quobyte-43b80206-a3b1-4ed8-8e76-01f13f54dc90" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:29:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1afead37-ab30-437b-b4dd-1f07f745a52e tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "cinder-quobyte-43b80206-a3b1-4ed8-8e76-01f13f54dc90" acquired by "delete_volume" :: waited 0.018s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:29:33 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f35615e-c2d4-4242-a920-b608edb5fd14]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:29:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1afead37-ab30-437b-b4dd-1f07f745a52e tempest-TestInstancesWithCinderVolumes-544510126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-43b80206-a3b1-4ed8-8e76-01f13f54dc90 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:33 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-43b80206-a3b1-4ed8-8e76-01f13f54dc90 Sep 01 08:29:33 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:33 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1afead37-ab30-437b-b4dd-1f07f745a52e tempest-TestInstancesWithCinderVolumes-544510126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-43b80206-a3b1-4ed8-8e76-01f13f54dc90" returned: 0 in 0.411s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1afead37-ab30-437b-b4dd-1f07f745a52e tempest-TestInstancesWithCinderVolumes-544510126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-43b80206-a3b1-4ed8-8e76-01f13f54dc90 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:33 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-43b80206-a3b1-4ed8-8e76-01f13f54dc90 Sep 01 08:29:33 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:33 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1afead37-ab30-437b-b4dd-1f07f745a52e tempest-TestInstancesWithCinderVolumes-544510126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-43b80206-a3b1-4ed8-8e76-01f13f54dc90" returned: 0 in 0.249s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1afead37-ab30-437b-b4dd-1f07f745a52e tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "cinder-quobyte-43b80206-a3b1-4ed8-8e76-01f13f54dc90" released by "delete_volume" :: held 0.699s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:29:33 devstack cinder-volume[86893]: WARNING cinder.quota [None req-1afead37-ab30-437b-b4dd-1f07f745a52e tempest-TestInstancesWithCinderVolumes-544510126 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1652706203-1358377966 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1652706203-1358377966, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:29:33 devstack cinder-volume[86893]: WARNING cinder.quota [None req-1afead37-ab30-437b-b4dd-1f07f745a52e tempest-TestInstancesWithCinderVolumes-544510126 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1652706203-1358377966 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1652706203-1358377966, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:29:33 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-1afead37-ab30-437b-b4dd-1f07f745a52e tempest-TestInstancesWithCinderVolumes-544510126 None] Created reservations ['cdeecd1c-b61a-4035-ab69-b70741bf05bd', '9d05a7bb-1efc-47d4-948c-a52c7c7b8c1e', 'fe58650a-7ec5-4a3f-b421-fae2755cb10e', '420b9ff6-7dfd-4da4-b27d-1fd234ba499e'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:29:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1afead37-ab30-437b-b4dd-1f07f745a52e tempest-TestInstancesWithCinderVolumes-544510126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:29:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1afead37-ab30-437b-b4dd-1f07f745a52e tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:29:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1afead37-ab30-437b-b4dd-1f07f745a52e tempest-TestInstancesWithCinderVolumes-544510126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:29:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1afead37-ab30-437b-b4dd-1f07f745a52e tempest-TestInstancesWithCinderVolumes-544510126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:29:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1afead37-ab30-437b-b4dd-1f07f745a52e tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:29:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1afead37-ab30-437b-b4dd-1f07f745a52e tempest-TestInstancesWithCinderVolumes-544510126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:33 devstack sudo[102780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:29:33 devstack sudo[102780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:34 devstack sudo[102780]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1afead37-ab30-437b-b4dd-1f07f745a52e tempest-TestInstancesWithCinderVolumes-544510126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.279s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:34 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-1afead37-ab30-437b-b4dd-1f07f745a52e tempest-TestInstancesWithCinderVolumes-544510126 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:29:34 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-1afead37-ab30-437b-b4dd-1f07f745a52e tempest-TestInstancesWithCinderVolumes-544510126 None] Deleted volume successfully. Sep 01 08:29:34 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1afead37-ab30-437b-b4dd-1f07f745a52e tempest-TestInstancesWithCinderVolumes-544510126 None] Lock "cinder-43b80206-a3b1-4ed8-8e76-01f13f54dc90-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:29:41 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:29:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Flow 'volume_create_manager' (059b519a-0167-4395-a115-097f3de64c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:29:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b69a7b-bbbf-4b76-aa50-e60a25492761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:29:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b69a7b-bbbf-4b76-aa50-e60a25492761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=816737ac-cea0-4d40-8647-fce936314d52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98d9d7fd3e354fbcbfb1bc4996e63c60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:29:41Z,use_quota=True,user_id='aa43308466704d7ab24d4bddd30ad321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(835685b3-6552-4502-a9f2-7f5f6a587439),volume_type_id=835685b3-6552-4502-a9f2-7f5f6a587439)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:29:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fcfbee6-f95b-43fd-84f6-3687a0db952b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:29:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fcfbee6-f95b-43fd-84f6-3687a0db952b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:29:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e093de-a4fb-4699-b71f-d1eeecdff12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:29:41 devstack cinder-volume[86893]: DEBUG cinder.image.glance [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Creating Keystone auth plugin from conf {{(pid=86893) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 08:29:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e093de-a4fb-4699-b71f-d1eeecdff12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '816737ac-cea0-4d40-8647-fce936314d52', 'volume_name': 'volume-816737ac-cea0-4d40-8647-fce936314d52', 'volume_size': 1, 'image_id': '0868edc9-c6d3-436b-b45d-348fd620b20e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0868edc9-c6d3-436b-b45d-348fd620b20e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9e4e4f88db9eeccd15d1e193addc9968', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '98d9d7fd3e354fbcbfb1bc4996e63c60', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4ea38afdf88daaeb8466823b84419256f9f717d6066e2dc8c6f8f47855485ee0c4160763247979abd121cc2e07ba9093682e46717cf7fa82327bcac8e85c454c', 'id': '0868edc9-c6d3-436b-b45d-348fd620b20e', 'created_at': datetime.datetime(2026, 9, 1, 6, 29, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 6, 29, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0868edc9-c6d3-436b-b45d-348fd620b20e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:29:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (862d0ba0-9d6f-480e-869f-f9b294942956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:29:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (862d0ba0-9d6f-480e-869f-f9b294942956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:29:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41626ac1-d60a-4f38-8048-d8524e0268f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:29:41 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Volume 816737ac-cea0-4d40-8647-fce936314d52: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-816737ac-cea0-4d40-8647-fce936314d52', 'volume_size': 1, 'image_id': '0868edc9-c6d3-436b-b45d-348fd620b20e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0868edc9-c6d3-436b-b45d-348fd620b20e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9e4e4f88db9eeccd15d1e193addc9968', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '98d9d7fd3e354fbcbfb1bc4996e63c60', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4ea38afdf88daaeb8466823b84419256f9f717d6066e2dc8c6f8f47855485ee0c4160763247979abd121cc2e07ba9093682e46717cf7fa82327bcac8e85c454c', 'id': '0868edc9-c6d3-436b-b45d-348fd620b20e', 'created_at': datetime.datetime(2026, 9, 1, 6, 29, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 6, 29, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0868edc9-c6d3-436b-b45d-348fd620b20e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 01 08:29:41 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Trying to clone 816737ac-cea0-4d40-8647-fce936314d52 from image 0868edc9-c6d3-436b-b45d-348fd620b20e at location (None, [{'url': 'file:///opt/stack/data/glance/images/0868edc9-c6d3-436b-b45d-348fd620b20e', 'metadata': {}}]). {{(pid=86893) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1100}} Sep 01 08:29:41 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0868edc9-c6d3-436b-b45d-348fd620b20e_60_i_4dcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86893) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 08:29:41 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Image download 0.00 MB at 0.00 MB/s Sep 01 08:29:41 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5cd9b1-c6a1-4036-a24b-eddf9b5c5cf1]: (4, 'raw') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:29:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0868edc9-c6d3-436b-b45d-348fd620b20e_60_i_4dcdevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:41 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0868edc9-c6d3-436b-b45d-348fd620b20e_60_i_4dcdevstack@QuobyteHD Sep 01 08:29:41 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:41 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0868edc9-c6d3-436b-b45d-348fd620b20e_60_i_4dcdevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0868edc9-c6d3-436b-b45d-348fd620b20e_60_i_4dcdevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:41 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0868edc9-c6d3-436b-b45d-348fd620b20e_60_i_4dcdevstack@QuobyteHD Sep 01 08:29:41 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:42 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0868edc9-c6d3-436b-b45d-348fd620b20e_60_i_4dcdevstack@QuobyteHD" returned: 1 in 0.348s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0868edc9-c6d3-436b-b45d-348fd620b20e_60_i_4dcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 08:29:42 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Temporary image 0868edc9-c6d3-436b-b45d-348fd620b20e is fetched for user aa43308466704d7ab24d4bddd30ad321. {{(pid=86893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 08:29:42 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[e988b2d2-09ff-4509-b17c-b6fd4c4b0270]: (4, 'raw') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:29:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0868edc9-c6d3-436b-b45d-348fd620b20e_60_i_4dcdevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:42 devstack sudo[102797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0868edc9-c6d3-436b-b45d-348fd620b20e_60_i_4dcdevstack@QuobyteHD Sep 01 08:29:42 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:42 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0868edc9-c6d3-436b-b45d-348fd620b20e_60_i_4dcdevstack@QuobyteHD" returned: 0 in 0.323s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0868edc9-c6d3-436b-b45d-348fd620b20e_60_i_4dcdevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:42 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0868edc9-c6d3-436b-b45d-348fd620b20e_60_i_4dcdevstack@QuobyteHD Sep 01 08:29:42 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:42 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0868edc9-c6d3-436b-b45d-348fd620b20e_60_i_4dcdevstack@QuobyteHD" returned: 1 in 0.316s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0868edc9-c6d3-436b-b45d-348fd620b20e_60_i_4dcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 08:29:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:29:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:29:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=816737ac-cea0-4d40-8647-fce936314d52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98d9d7fd3e354fbcbfb1bc4996e63c60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:29:41Z,use_quota=True,user_id='aa43308466704d7ab24d4bddd30ad321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(835685b3-6552-4502-a9f2-7f5f6a587439),volume_type_id=835685b3-6552-4502-a9f2-7f5f6a587439)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:29:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Creating volume 816737ac-cea0-4d40-8647-fce936314d52 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:29:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:29:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:29:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:29:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:29:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:29:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:29:42 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:29:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-816737ac-cea0-4d40-8647-fce936314d52 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:42 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-816737ac-cea0-4d40-8647-fce936314d52 1073741824 Sep 01 08:29:42 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:43 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-816737ac-cea0-4d40-8647-fce936314d52 1073741824" returned: 0 in 0.468s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-816737ac-cea0-4d40-8647-fce936314d52 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:43 devstack sudo[102811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-816737ac-cea0-4d40-8647-fce936314d52 Sep 01 08:29:43 devstack sudo[102811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:43 devstack sudo[102811]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-816737ac-cea0-4d40-8647-fce936314d52" returned: 0 in 0.247s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:43 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:29:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:29:43 devstack cinder-volume[86893]: DEBUG cinder.volume.volume_utils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Attempting download of 0868edc9-c6d3-436b-b45d-348fd620b20e ((None, [{'url': 'file:///opt/stack/data/glance/images/0868edc9-c6d3-436b-b45d-348fd620b20e', 'metadata': {}}])) to volume 816737ac-cea0-4d40-8647-fce936314d52. {{(pid=86893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 08:29:43 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1e5e51-b2af-44c7-b85c-0a1e6f8438d5]: (4, 'raw') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:29:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0868edc9-c6d3-436b-b45d-348fd620b20e_rnyo7uh0 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:43 devstack sudo[102814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0868edc9-c6d3-436b-b45d-348fd620b20e_rnyo7uh0 Sep 01 08:29:43 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:44 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0868edc9-c6d3-436b-b45d-348fd620b20e_rnyo7uh0" returned: 0 in 0.361s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0868edc9-c6d3-436b-b45d-348fd620b20e_rnyo7uh0 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:44 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0868edc9-c6d3-436b-b45d-348fd620b20e_rnyo7uh0 Sep 01 08:29:44 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:44 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0868edc9-c6d3-436b-b45d-348fd620b20e_rnyo7uh0" returned: 1 in 0.327s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0868edc9-c6d3-436b-b45d-348fd620b20e_rnyo7uh0' failed. Not Retrying. {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 08:29:44 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fab57de-6990-4ce5-ad2c-9f5be9eeedc0]: (4, 'raw') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:29:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0868edc9-c6d3-436b-b45d-348fd620b20e_60_i_4dcdevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:44 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0868edc9-c6d3-436b-b45d-348fd620b20e_60_i_4dcdevstack@QuobyteHD Sep 01 08:29:44 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:44 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0868edc9-c6d3-436b-b45d-348fd620b20e_60_i_4dcdevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0868edc9-c6d3-436b-b45d-348fd620b20e_60_i_4dcdevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:44 devstack sudo[102827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0868edc9-c6d3-436b-b45d-348fd620b20e_60_i_4dcdevstack@QuobyteHD Sep 01 08:29:44 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:45 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0868edc9-c6d3-436b-b45d-348fd620b20e_60_i_4dcdevstack@QuobyteHD" returned: 1 in 0.334s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0868edc9-c6d3-436b-b45d-348fd620b20e_60_i_4dcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 08:29:45 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] 0868edc9-c6d3-436b-b45d-348fd620b20e was raw, converting to qcow2 {{(pid=86893) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 08:29:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0868edc9-c6d3-436b-b45d-348fd620b20e_60_i_4dcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-816737ac-cea0-4d40-8647-fce936314d52 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:45 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0868edc9-c6d3-436b-b45d-348fd620b20e_60_i_4dcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-816737ac-cea0-4d40-8647-fce936314d52 Sep 01 08:29:45 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:45 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0868edc9-c6d3-436b-b45d-348fd620b20e_60_i_4dcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-816737ac-cea0-4d40-8647-fce936314d52" returned: 0 in 0.529s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:45 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0868edc9-c6d3-436b-b45d-348fd620b20e_60_i_4dcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-816737ac-cea0-4d40-8647-fce936314d52 {{(pid=86893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 08:29:45 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 08:29:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-816737ac-cea0-4d40-8647-fce936314d52 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:45 devstack sudo[102839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-816737ac-cea0-4d40-8647-fce936314d52 1G Sep 01 08:29:45 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:46 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-816737ac-cea0-4d40-8647-fce936314d52 1G" returned: 0 in 0.332s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:46 devstack cinder-volume[86893]: DEBUG cinder.volume.volume_utils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Downloaded image 0868edc9-c6d3-436b-b45d-348fd620b20e ((None, [{'url': 'file:///opt/stack/data/glance/images/0868edc9-c6d3-436b-b45d-348fd620b20e', 'metadata': {}}])) to volume 816737ac-cea0-4d40-8647-fce936314d52 successfully. {{(pid=86893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 08:29:46 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Temporary image 0868edc9-c6d3-436b-b45d-348fd620b20e for user aa43308466704d7ab24d4bddd30ad321 is deleted. {{(pid=86893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 08:29:46 devstack cinder-volume[86893]: DEBUG cinder.volume.volume_utils [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Marking volume 816737ac-cea0-4d40-8647-fce936314d52 as bootable. {{(pid=86893) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 08:29:46 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Copying metadata from image 0868edc9-c6d3-436b-b45d-348fd620b20e to 816737ac-cea0-4d40-8647-fce936314d52. {{(pid=86893) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 08:29:46 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Creating volume glance metadata for volume 816737ac-cea0-4d40-8647-fce936314d52 backed by image 0868edc9-c6d3-436b-b45d-348fd620b20e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '0868edc9-c6d3-436b-b45d-348fd620b20e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '9e4e4f88db9eeccd15d1e193addc9968', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86893) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 08:29:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41626ac1-d60a-4f38-8048-d8524e0268f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-816737ac-cea0-4d40-8647-fce936314d52', 'volume_size': 1, 'image_id': '0868edc9-c6d3-436b-b45d-348fd620b20e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0868edc9-c6d3-436b-b45d-348fd620b20e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9e4e4f88db9eeccd15d1e193addc9968', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '98d9d7fd3e354fbcbfb1bc4996e63c60', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4ea38afdf88daaeb8466823b84419256f9f717d6066e2dc8c6f8f47855485ee0c4160763247979abd121cc2e07ba9093682e46717cf7fa82327bcac8e85c454c', 'id': '0868edc9-c6d3-436b-b45d-348fd620b20e', 'created_at': datetime.datetime(2026, 9, 1, 6, 29, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 6, 29, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0868edc9-c6d3-436b-b45d-348fd620b20e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:29:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e93da90-eb3e-4601-b45b-a9bdd72708aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:29:46 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Volume volume-816737ac-cea0-4d40-8647-fce936314d52 (816737ac-cea0-4d40-8647-fce936314d52): created successfully Sep 01 08:29:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e93da90-eb3e-4601-b45b-a9bdd72708aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:29:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Flow 'volume_create_manager' (059b519a-0167-4395-a115-097f3de64c31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:29:46 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-5beda252-0f5b-4b3d-8cdf-60838948fcab tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Created volume successfully. Sep 01 08:29:46 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a06c57a4-f620-42a9-95a5-9f32904c5f08 tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Acquiring lock "cinder-816737ac-cea0-4d40-8647-fce936314d52-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:29:46 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a06c57a4-f620-42a9-95a5-9f32904c5f08 tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Lock "cinder-816737ac-cea0-4d40-8647-fce936314d52-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:29:46 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a06c57a4-f620-42a9-95a5-9f32904c5f08 tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Acquiring lock "cinder-quobyte-816737ac-cea0-4d40-8647-fce936314d52" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:29:46 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a06c57a4-f620-42a9-95a5-9f32904c5f08 tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Lock "cinder-quobyte-816737ac-cea0-4d40-8647-fce936314d52" acquired by "delete_volume" :: waited 0.018s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:29:46 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0eaa5a-bc68-4d71-ba1d-4021c947168c]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:29:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a06c57a4-f620-42a9-95a5-9f32904c5f08 tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-816737ac-cea0-4d40-8647-fce936314d52 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:46 devstack sudo[102845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-816737ac-cea0-4d40-8647-fce936314d52 Sep 01 08:29:46 devstack sudo[102845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:46 devstack sudo[102845]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a06c57a4-f620-42a9-95a5-9f32904c5f08 tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-816737ac-cea0-4d40-8647-fce936314d52" returned: 0 in 0.353s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a06c57a4-f620-42a9-95a5-9f32904c5f08 tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-816737ac-cea0-4d40-8647-fce936314d52 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:46 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-816737ac-cea0-4d40-8647-fce936314d52 Sep 01 08:29:46 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:47 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a06c57a4-f620-42a9-95a5-9f32904c5f08 tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-816737ac-cea0-4d40-8647-fce936314d52" returned: 0 in 0.275s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:47 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a06c57a4-f620-42a9-95a5-9f32904c5f08 tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Lock "cinder-quobyte-816737ac-cea0-4d40-8647-fce936314d52" released by "delete_volume" :: held 0.678s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:29:47 devstack cinder-volume[86893]: WARNING cinder.quota [None req-a06c57a4-f620-42a9-95a5-9f32904c5f08 tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:29:47 devstack cinder-volume[86893]: WARNING cinder.quota [None req-a06c57a4-f620-42a9-95a5-9f32904c5f08 tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 01 08:29:47 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-a06c57a4-f620-42a9-95a5-9f32904c5f08 tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Created reservations ['d8cd3c77-5b06-4ae8-a103-84f2aa0215eb', '8ed0076b-3ee0-4173-aca2-d4c576b1e32d', 'd115efb7-4688-41f0-a534-e7353c1b7c8c', '02e3bdd8-5d7d-48f0-86b5-ac1d1efcc7d1'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:29:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a06c57a4-f620-42a9-95a5-9f32904c5f08 tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:29:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a06c57a4-f620-42a9-95a5-9f32904c5f08 tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:29:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a06c57a4-f620-42a9-95a5-9f32904c5f08 tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:29:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a06c57a4-f620-42a9-95a5-9f32904c5f08 tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:29:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a06c57a4-f620-42a9-95a5-9f32904c5f08 tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:29:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a06c57a4-f620-42a9-95a5-9f32904c5f08 tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:47 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:29:47 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:47 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a06c57a4-f620-42a9-95a5-9f32904c5f08 tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.286s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:47 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-a06c57a4-f620-42a9-95a5-9f32904c5f08 tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:29:47 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-a06c57a4-f620-42a9-95a5-9f32904c5f08 tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Deleted volume successfully. Sep 01 08:29:47 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a06c57a4-f620-42a9-95a5-9f32904c5f08 tempest-VolumeAndVolumeTypeFromImageTest-619640820 None] Lock "cinder-816737ac-cea0-4d40-8647-fce936314d52-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:29:52 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:29:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] Flow 'volume_create_manager' (8244b1df-149a-4c45-abe1-a5b02ea9c755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:29:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e537417-a286-411c-81b8-e280e7302035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:29:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e537417-a286-411c-81b8-e280e7302035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1552630373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef7f689b-f532-4417-ad32-1e161c5085af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dba636bb729410590daffba58f8aa9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:29:52Z,use_quota=True,user_id='d6da3a2fb7bf4d07a68354c137260790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:29:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468b0bd0-3e7f-4367-aae0-9303205e8172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:29:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468b0bd0-3e7f-4367-aae0-9303205e8172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:29:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45bd8af1-0eb8-4935-b79a-2d8c5f6daeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:29:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45bd8af1-0eb8-4935-b79a-2d8c5f6daeb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef7f689b-f532-4417-ad32-1e161c5085af', 'volume_name': 'volume-ef7f689b-f532-4417-ad32-1e161c5085af', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:29:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3b8a4e-0d4d-41bc-8608-a8fe0ea306b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:29:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3b8a4e-0d4d-41bc-8608-a8fe0ea306b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:29:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e5f86bf-9c03-48b0-a802-197bcaab960d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:29:52 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] Volume ef7f689b-f532-4417-ad32-1e161c5085af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef7f689b-f532-4417-ad32-1e161c5085af', 'volume_size': 1} Sep 01 08:29:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:29:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:29:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1552630373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef7f689b-f532-4417-ad32-1e161c5085af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dba636bb729410590daffba58f8aa9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:29:52Z,use_quota=True,user_id='d6da3a2fb7bf4d07a68354c137260790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:29:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] Creating volume ef7f689b-f532-4417-ad32-1e161c5085af {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:29:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:29:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:29:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:29:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:29:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:29:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:29:52 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:29:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:52 devstack sudo[102857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af 1073741824 Sep 01 08:29:52 devstack sudo[102857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:52 devstack sudo[102857]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af 1073741824" returned: 0 in 0.498s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:52 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af Sep 01 08:29:52 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:53 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af" returned: 0 in 0.295s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:53 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:29:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:29:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e5f86bf-9c03-48b0-a802-197bcaab960d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef7f689b-f532-4417-ad32-1e161c5085af', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:29:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd5c9fd-6323-437a-aed1-2d80230dc76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:29:53 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] Volume volume-ef7f689b-f532-4417-ad32-1e161c5085af (ef7f689b-f532-4417-ad32-1e161c5085af): created successfully Sep 01 08:29:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd5c9fd-6323-437a-aed1-2d80230dc76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:29:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] Flow 'volume_create_manager' (8244b1df-149a-4c45-abe1-a5b02ea9c755) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:29:53 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-8c4fef3a-3b35-49f9-a5fb-db6382d1823c tempest-VolumeDependencyTests-296590295 None] Created volume successfully. Sep 01 08:29:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8a2cead2-5f09-4f21-9dc6-8bbc67a995b0 tempest-VolumeDependencyTests-296590295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:29:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8a2cead2-5f09-4f21-9dc6-8bbc67a995b0 tempest-VolumeDependencyTests-296590295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:29:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-8a2cead2-5f09-4f21-9dc6-8bbc67a995b0 tempest-VolumeDependencyTests-296590295 None] Creating offline snapshot fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e of volume ef7f689b-f532-4417-ad32-1e161c5085af {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:29:54 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb27e0c-9474-42f6-a456-c728fac1a0b5]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:29:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8a2cead2-5f09-4f21-9dc6-8bbc67a995b0 tempest-VolumeDependencyTests-296590295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:54 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af Sep 01 08:29:54 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:54 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8a2cead2-5f09-4f21-9dc6-8bbc67a995b0 tempest-VolumeDependencyTests-296590295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af" returned: 0 in 0.376s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8a2cead2-5f09-4f21-9dc6-8bbc67a995b0 tempest-VolumeDependencyTests-296590295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af.fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:54 devstack sudo[102871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af.fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e 1G Sep 01 08:29:54 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:55 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8a2cead2-5f09-4f21-9dc6-8bbc67a995b0 tempest-VolumeDependencyTests-296590295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af.fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e 1G" returned: 0 in 0.516s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8a2cead2-5f09-4f21-9dc6-8bbc67a995b0 tempest-VolumeDependencyTests-296590295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef7f689b-f532-4417-ad32-1e161c5085af -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af.fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:55 devstack sudo[102877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef7f689b-f532-4417-ad32-1e161c5085af -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af.fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e Sep 01 08:29:55 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:55 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8a2cead2-5f09-4f21-9dc6-8bbc67a995b0 tempest-VolumeDependencyTests-296590295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef7f689b-f532-4417-ad32-1e161c5085af -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af.fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e" returned: 0 in 0.353s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:55 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-8a2cead2-5f09-4f21-9dc6-8bbc67a995b0 tempest-VolumeDependencyTests-296590295 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af.fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e is being set with open permissions: ugo+rw Sep 01 08:29:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8a2cead2-5f09-4f21-9dc6-8bbc67a995b0 tempest-VolumeDependencyTests-296590295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af.fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:55 devstack sudo[102882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af.fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e Sep 01 08:29:55 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:55 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8a2cead2-5f09-4f21-9dc6-8bbc67a995b0 tempest-VolumeDependencyTests-296590295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af.fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e" returned: 0 in 0.263s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8a2cead2-5f09-4f21-9dc6-8bbc67a995b0 tempest-VolumeDependencyTests-296590295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:56 devstack sudo[102885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af.info Sep 01 08:29:56 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:56 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8a2cead2-5f09-4f21-9dc6-8bbc67a995b0 tempest-VolumeDependencyTests-296590295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af.info" returned: 0 in 0.253s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:56 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-8a2cead2-5f09-4f21-9dc6-8bbc67a995b0 tempest-VolumeDependencyTests-296590295 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af.info is being set with open permissions: ugo+rw Sep 01 08:29:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8a2cead2-5f09-4f21-9dc6-8bbc67a995b0 tempest-VolumeDependencyTests-296590295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:56 devstack sudo[102888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af.info Sep 01 08:29:56 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:56 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8a2cead2-5f09-4f21-9dc6-8bbc67a995b0 tempest-VolumeDependencyTests-296590295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af.info" returned: 0 in 0.274s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8a2cead2-5f09-4f21-9dc6-8bbc67a995b0 tempest-VolumeDependencyTests-296590295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.134s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:29:56 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-8a2cead2-5f09-4f21-9dc6-8bbc67a995b0 tempest-VolumeDependencyTests-296590295 None] Create snapshot completed successfully Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Flow 'volume_create_manager' (61ab05c3-6303-4d95-b3c6-26e4f8aacb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84446112-56df-47f6-a343-d8e784bc2b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84446112-56df-47f6-a343-d8e784bc2b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1511479392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dba636bb729410590daffba58f8aa9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:29:58Z,use_quota=True,user_id='d6da3a2fb7bf4d07a68354c137260790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a0b0efa-4ae5-4a2d-ae9b-2b79f5ca9d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a0b0efa-4ae5-4a2d-ae9b-2b79f5ca9d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9abe8f91-453c-4fa5-9146-c88de2d4a69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9abe8f91-453c-4fa5-9146-c88de2d4a69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2', 'volume_name': 'volume-4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2', 'volume_size': 1, 'snapshot_id': 'fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e'}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c567fb-0332-4f11-a0e7-46ffbfe9cb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c567fb-0332-4f11-a0e7-46ffbfe9cb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9478fca-a587-43d5-baf5-80e694782a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:29:58 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Volume 4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2', 'volume_size': 1, 'snapshot_id': 'fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e'} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Acquiring lock "cinder-quobyte-fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e-4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2" by "_create_volume_from_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Lock "cinder-quobyte-fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e-4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Creating volume 4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2 from snapshot fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e {{(pid=86893) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Acquiring lock "cinder-quobyte-4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2" by "_copy_volume_from_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Lock "cinder-quobyte-4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] snapshot: fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e, volume: 4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2, {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c8fe75-f56b-419b-ad34-916126eb4f8d]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af.fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:58 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af.fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e Sep 01 08:29:58 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:58 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af.fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e" returned: 0 in 0.386s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef7f689b-f532-4417-ad32-1e161c5085af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[91da7fd0-61a2-433d-a3c6-68db442c4546]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:29:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:58 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af Sep 01 08:29:58 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:29:59 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Sep 01 08:29:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af" returned: 0 in 0.383s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:29:59 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 08:29:59 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Creating direct copy from snapshot {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 08:29:59 devstack cinder-volume[86893]: DEBUG cinder.utils [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Path /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2 not found in is_blk_device check {{(pid=86893) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 08:29:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:29:59 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2 Sep 01 08:29:59 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:30:03 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Sep 01 08:30:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2" returned: 0 in 4.826s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:30:03 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Image conversion details: src /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af, size 1024.00 MB, duration 4.83 sec, destination /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2 {{(pid=86893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 08:30:03 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Converted 1024.00 MB image at 212.09 MB/s Sep 01 08:30:03 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2 is being set with open permissions: ugo+rw Sep 01 08:30:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:30:03 devstack sudo[102916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2 Sep 01 08:30:03 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:30:04 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root Sep 01 08:30:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2" returned: 0 in 0.296s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:30:04 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Lock "cinder-quobyte-4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2" released by "_copy_volume_from_snapshot" :: held 5.977s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:30:04 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=76,cinder:UPDATE=63,cinder:INSERT=21,cinder:DELETE=6 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:30:04 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=74,cinder:UPDATE=73,cinder:INSERT=20,cinder:DELETE=3 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:30:04 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Lock "cinder-quobyte-fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e-4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2" released by "_create_volume_from_snapshot" :: held 6.062s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:30:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.077s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:30:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9478fca-a587-43d5-baf5-80e694782a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2', 'volume_size': 1, 'snapshot_id': 'fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e'}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:30:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a928b4f-9cf0-42d5-930d-c99c12f2d7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:30:04 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Volume volume-4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2 (4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2): created successfully Sep 01 08:30:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a928b4f-9cf0-42d5-930d-c99c12f2d7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:30:04 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Flow 'volume_create_manager' (61ab05c3-6303-4d95-b3c6-26e4f8aacb9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:30:04 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-1b6d2932-4821-4706-a292-a9b19c0c8e8a tempest-VolumeDependencyTests-296590295 None] Created volume successfully. Sep 01 08:30:04 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9d46a31f-e524-462e-9a2a-6071c763deda tempest-VolumeDependencyTests-296590295 None] Acquiring lock "cinder-fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:30:04 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9d46a31f-e524-462e-9a2a-6071c763deda tempest-VolumeDependencyTests-296590295 None] Lock "cinder-fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:30:04 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9d46a31f-e524-462e-9a2a-6071c763deda tempest-VolumeDependencyTests-296590295 None] Acquiring lock "cinder-quobyte-ef7f689b-f532-4417-ad32-1e161c5085af" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:30:04 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9d46a31f-e524-462e-9a2a-6071c763deda tempest-VolumeDependencyTests-296590295 None] Lock "cinder-quobyte-ef7f689b-f532-4417-ad32-1e161c5085af" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:30:04 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9d46a31f-e524-462e-9a2a-6071c763deda tempest-VolumeDependencyTests-296590295 None] Acquiring lock "cinder-quobyte-fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:30:04 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9d46a31f-e524-462e-9a2a-6071c763deda tempest-VolumeDependencyTests-296590295 None] Lock "cinder-quobyte-fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:30:04 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-9d46a31f-e524-462e-9a2a-6071c763deda tempest-VolumeDependencyTests-296590295 None] Deleting offline snapshot fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e of volume ef7f689b-f532-4417-ad32-1e161c5085af {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:30:04 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-9d46a31f-e524-462e-9a2a-6071c763deda tempest-VolumeDependencyTests-296590295 None] snapshot_file for this snap is: volume-ef7f689b-f532-4417-ad32-1e161c5085af.fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:30:04 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cf2ab6-d4d4-4efb-9209-1c2cddebdb7b]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:30:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9d46a31f-e524-462e-9a2a-6071c763deda tempest-VolumeDependencyTests-296590295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af.fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:30:05 devstack sudo[102919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af.fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e Sep 01 08:30:05 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:30:05 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root Sep 01 08:30:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9d46a31f-e524-462e-9a2a-6071c763deda tempest-VolumeDependencyTests-296590295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af.fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e" returned: 0 in 0.389s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:30:05 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-9d46a31f-e524-462e-9a2a-6071c763deda tempest-VolumeDependencyTests-296590295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef7f689b-f532-4417-ad32-1e161c5085af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:30:05 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4f368a-8717-4ddc-bfea-26661996a590]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:30:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9d46a31f-e524-462e-9a2a-6071c763deda tempest-VolumeDependencyTests-296590295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:30:05 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af Sep 01 08:30:05 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:30:05 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Sep 01 08:30:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9d46a31f-e524-462e-9a2a-6071c763deda tempest-VolumeDependencyTests-296590295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af" returned: 0 in 0.592s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:30:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9d46a31f-e524-462e-9a2a-6071c763deda tempest-VolumeDependencyTests-296590295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af.fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:30:05 devstack sudo[102929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af.fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e Sep 01 08:30:05 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:30:06 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root Sep 01 08:30:06 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9d46a31f-e524-462e-9a2a-6071c763deda tempest-VolumeDependencyTests-296590295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af.fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e" returned: 0 in 0.390s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:30:06 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9d46a31f-e524-462e-9a2a-6071c763deda tempest-VolumeDependencyTests-296590295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af.fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:30:06 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af.fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e Sep 01 08:30:06 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:30:06 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Sep 01 08:30:06 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9d46a31f-e524-462e-9a2a-6071c763deda tempest-VolumeDependencyTests-296590295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af.fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e" returned: 0 in 0.271s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:30:06 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9d46a31f-e524-462e-9a2a-6071c763deda tempest-VolumeDependencyTests-296590295 None] Lock "cinder-quobyte-fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e" released by "_delete_snapshot" :: held 1.739s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:30:06 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9d46a31f-e524-462e-9a2a-6071c763deda tempest-VolumeDependencyTests-296590295 None] Lock "cinder-quobyte-ef7f689b-f532-4417-ad32-1e161c5085af" released by "delete_snapshot" :: held 1.761s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:30:06 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-9d46a31f-e524-462e-9a2a-6071c763deda tempest-VolumeDependencyTests-296590295 None] Created reservations ['4a7adf8d-a17d-45d9-8cb3-a420609f8767', '209f8b91-e628-4b54-b99f-bbc041f796d4', '14a1559f-ed8d-4539-99e9-7710a4ed1666', '04571fd1-95b3-4ac1-8461-1be77b05bd2e'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:30:06 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-9d46a31f-e524-462e-9a2a-6071c763deda tempest-VolumeDependencyTests-296590295 None] Delete snapshot completed successfully. Sep 01 08:30:06 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9d46a31f-e524-462e-9a2a-6071c763deda tempest-VolumeDependencyTests-296590295 None] Lock "cinder-fe5e1b62-bb5b-4c8a-9202-dbf6a8679b5e-delete_snapshot" released by "delete_snapshot" :: held 1.904s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:30:07 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-28d85078-a328-41a8-8715-f2ac2fd82a13 tempest-VolumeDependencyTests-296590295 None] Acquiring lock "cinder-ef7f689b-f532-4417-ad32-1e161c5085af-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:30:07 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-28d85078-a328-41a8-8715-f2ac2fd82a13 tempest-VolumeDependencyTests-296590295 None] Lock "cinder-ef7f689b-f532-4417-ad32-1e161c5085af-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:30:07 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-28d85078-a328-41a8-8715-f2ac2fd82a13 tempest-VolumeDependencyTests-296590295 None] Acquiring lock "cinder-quobyte-ef7f689b-f532-4417-ad32-1e161c5085af" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:30:07 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-28d85078-a328-41a8-8715-f2ac2fd82a13 tempest-VolumeDependencyTests-296590295 None] Lock "cinder-quobyte-ef7f689b-f532-4417-ad32-1e161c5085af" acquired by "delete_volume" :: waited 0.014s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:30:07 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[57767b88-aec1-43ae-9d01-dcfae91576d5]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:30:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-28d85078-a328-41a8-8715-f2ac2fd82a13 tempest-VolumeDependencyTests-296590295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:30:07 devstack sudo[102938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af Sep 01 08:30:07 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:30:07 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root Sep 01 08:30:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-28d85078-a328-41a8-8715-f2ac2fd82a13 tempest-VolumeDependencyTests-296590295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af" returned: 0 in 0.380s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:30:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-28d85078-a328-41a8-8715-f2ac2fd82a13 tempest-VolumeDependencyTests-296590295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:30:07 devstack sudo[102944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af Sep 01 08:30:07 devstack sudo[102944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:30:07 devstack sudo[102944]: pam_unix(sudo:session): session closed for user root Sep 01 08:30:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-28d85078-a328-41a8-8715-f2ac2fd82a13 tempest-VolumeDependencyTests-296590295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ef7f689b-f532-4417-ad32-1e161c5085af" returned: 0 in 0.247s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:30:07 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-28d85078-a328-41a8-8715-f2ac2fd82a13 tempest-VolumeDependencyTests-296590295 None] Lock "cinder-quobyte-ef7f689b-f532-4417-ad32-1e161c5085af" released by "delete_volume" :: held 0.689s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:30:07 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-28d85078-a328-41a8-8715-f2ac2fd82a13 tempest-VolumeDependencyTests-296590295 None] Created reservations ['62ddd97c-87d0-4f2d-9bcf-0a1d4ed12a33', '5b903048-c710-439f-ad0e-8edf7650fdb8', 'fdcc9b2f-0451-4191-802c-2edd7a6fbd00', '10ce072b-7ddc-48a4-a801-e85c738687a7'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:30:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-28d85078-a328-41a8-8715-f2ac2fd82a13 tempest-VolumeDependencyTests-296590295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:30:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-28d85078-a328-41a8-8715-f2ac2fd82a13 tempest-VolumeDependencyTests-296590295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:30:07 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-28d85078-a328-41a8-8715-f2ac2fd82a13 tempest-VolumeDependencyTests-296590295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:30:07 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-28d85078-a328-41a8-8715-f2ac2fd82a13 tempest-VolumeDependencyTests-296590295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:30:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-28d85078-a328-41a8-8715-f2ac2fd82a13 tempest-VolumeDependencyTests-296590295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:30:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-28d85078-a328-41a8-8715-f2ac2fd82a13 tempest-VolumeDependencyTests-296590295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:30:07 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:30:07 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:30:08 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Sep 01 08:30:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-28d85078-a328-41a8-8715-f2ac2fd82a13 tempest-VolumeDependencyTests-296590295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.280s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:30:08 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-28d85078-a328-41a8-8715-f2ac2fd82a13 tempest-VolumeDependencyTests-296590295 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:30:08 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-28d85078-a328-41a8-8715-f2ac2fd82a13 tempest-VolumeDependencyTests-296590295 None] Deleted volume successfully. Sep 01 08:30:08 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-28d85078-a328-41a8-8715-f2ac2fd82a13 tempest-VolumeDependencyTests-296590295 None] Lock "cinder-ef7f689b-f532-4417-ad32-1e161c5085af-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:30:08 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d31e631c-9377-46d0-b9ea-29fd513579d1 tempest-VolumeDependencyTests-296590295 None] Acquiring lock "cinder-4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:30:08 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d31e631c-9377-46d0-b9ea-29fd513579d1 tempest-VolumeDependencyTests-296590295 None] Lock "cinder-4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:30:08 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d31e631c-9377-46d0-b9ea-29fd513579d1 tempest-VolumeDependencyTests-296590295 None] Acquiring lock "cinder-quobyte-4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:30:08 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d31e631c-9377-46d0-b9ea-29fd513579d1 tempest-VolumeDependencyTests-296590295 None] Lock "cinder-quobyte-4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2" acquired by "delete_volume" :: waited 0.017s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:30:08 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[f470291f-5043-49ed-8713-40a7c5367ad2]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:30:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d31e631c-9377-46d0-b9ea-29fd513579d1 tempest-VolumeDependencyTests-296590295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:30:08 devstack sudo[102950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2 Sep 01 08:30:08 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:30:08 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root Sep 01 08:30:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d31e631c-9377-46d0-b9ea-29fd513579d1 tempest-VolumeDependencyTests-296590295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2" returned: 0 in 0.391s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:30:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d31e631c-9377-46d0-b9ea-29fd513579d1 tempest-VolumeDependencyTests-296590295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:30:08 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2 Sep 01 08:30:08 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:30:09 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Sep 01 08:30:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d31e631c-9377-46d0-b9ea-29fd513579d1 tempest-VolumeDependencyTests-296590295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2" returned: 0 in 0.259s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:30:09 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d31e631c-9377-46d0-b9ea-29fd513579d1 tempest-VolumeDependencyTests-296590295 None] Lock "cinder-quobyte-4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2" released by "delete_volume" :: held 0.693s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:30:09 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-d31e631c-9377-46d0-b9ea-29fd513579d1 tempest-VolumeDependencyTests-296590295 None] Created reservations ['358999ed-5a78-4070-bd03-2025a20de5f0', '02455577-a819-4b8e-ade0-47c0fb2ebcf5', '4b720da6-6fc4-4a70-96e4-79ebc5cdd02e', '3b39c9ed-27fa-44a4-a586-7a8503687fef'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:30:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d31e631c-9377-46d0-b9ea-29fd513579d1 tempest-VolumeDependencyTests-296590295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:30:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d31e631c-9377-46d0-b9ea-29fd513579d1 tempest-VolumeDependencyTests-296590295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:30:09 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d31e631c-9377-46d0-b9ea-29fd513579d1 tempest-VolumeDependencyTests-296590295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:30:09 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d31e631c-9377-46d0-b9ea-29fd513579d1 tempest-VolumeDependencyTests-296590295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:30:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d31e631c-9377-46d0-b9ea-29fd513579d1 tempest-VolumeDependencyTests-296590295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:30:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d31e631c-9377-46d0-b9ea-29fd513579d1 tempest-VolumeDependencyTests-296590295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:30:09 devstack sudo[102958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:30:09 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:30:09 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root Sep 01 08:30:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d31e631c-9377-46d0-b9ea-29fd513579d1 tempest-VolumeDependencyTests-296590295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.289s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:30:09 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-d31e631c-9377-46d0-b9ea-29fd513579d1 tempest-VolumeDependencyTests-296590295 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:30:09 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-d31e631c-9377-46d0-b9ea-29fd513579d1 tempest-VolumeDependencyTests-296590295 None] Deleted volume successfully. Sep 01 08:30:09 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-d31e631c-9377-46d0-b9ea-29fd513579d1 tempest-VolumeDependencyTests-296590295 None] Lock "cinder-4ef151c2-d7d5-4f01-8a9c-ec62af35f4f2-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:30:19 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=13,cinder:INSERT=5,cinder:UPDATE=25 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:30:19 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=20,cinder:UPDATE=22,cinder:DELETE=3,cinder:INSERT=8 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:30:21 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:30:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] Flow 'volume_create_manager' (11b98af9-e8f0-4ba9-b8a2-480efaff8e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:30:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f432fc9a-5506-401b-bcea-4596f762ee61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:30:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f432fc9a-5506-401b-bcea-4596f762ee61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-674294592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d972cf46-720a-4ef1-99fe-8559a7b1b14a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd803f8b07d94f3aab6155ed91971a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:30:21Z,use_quota=True,user_id='d2df43418f7543b8b25fa2fa15f82c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:30:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02329776-0eee-4f21-b780-8692453815c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:30:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02329776-0eee-4f21-b780-8692453815c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:30:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22a8ec27-32f5-48a6-9f0a-b9f99e75f688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:30:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22a8ec27-32f5-48a6-9f0a-b9f99e75f688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd972cf46-720a-4ef1-99fe-8559a7b1b14a', 'volume_name': 'volume-d972cf46-720a-4ef1-99fe-8559a7b1b14a', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:30:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7e66ac-33c4-4195-96cb-c74c9c456d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:30:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7e66ac-33c4-4195-96cb-c74c9c456d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:30:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d0ab50a-2192-4e71-b339-ea869bbd1617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:30:21 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] Volume d972cf46-720a-4ef1-99fe-8559a7b1b14a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d972cf46-720a-4ef1-99fe-8559a7b1b14a', 'volume_size': 1} Sep 01 08:30:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:30:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:30:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-674294592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d972cf46-720a-4ef1-99fe-8559a7b1b14a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd803f8b07d94f3aab6155ed91971a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:30:21Z,use_quota=True,user_id='d2df43418f7543b8b25fa2fa15f82c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:30:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] Creating volume d972cf46-720a-4ef1-99fe-8559a7b1b14a {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:30:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:30:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:30:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:30:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:30:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:30:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:30:21 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:30:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d972cf46-720a-4ef1-99fe-8559a7b1b14a 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:30:21 devstack sudo[103112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d972cf46-720a-4ef1-99fe-8559a7b1b14a 1073741824 Sep 01 08:30:21 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:30:21 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root Sep 01 08:30:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d972cf46-720a-4ef1-99fe-8559a7b1b14a 1073741824" returned: 0 in 0.428s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:30:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d972cf46-720a-4ef1-99fe-8559a7b1b14a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:30:21 devstack sudo[103120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d972cf46-720a-4ef1-99fe-8559a7b1b14a Sep 01 08:30:21 devstack sudo[103120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:30:21 devstack sudo[103120]: pam_unix(sudo:session): session closed for user root Sep 01 08:30:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d972cf46-720a-4ef1-99fe-8559a7b1b14a" returned: 0 in 0.250s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:30:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:30:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:30:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d0ab50a-2192-4e71-b339-ea869bbd1617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d972cf46-720a-4ef1-99fe-8559a7b1b14a', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:30:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bffd97ce-a797-4379-ab7b-44242fe77f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:30:22 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] Volume volume-d972cf46-720a-4ef1-99fe-8559a7b1b14a (d972cf46-720a-4ef1-99fe-8559a7b1b14a): created successfully Sep 01 08:30:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bffd97ce-a797-4379-ab7b-44242fe77f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:30:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] Flow 'volume_create_manager' (11b98af9-e8f0-4ba9-b8a2-480efaff8e1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:30:22 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-cfa8a930-c12a-4a88-b792-1859b741fa3c tempest-TestMinimumBasicScenario-1144717405 None] Created volume successfully. Sep 01 08:30:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-54541b62-4b13-4302-9c41-c82d35e78d81 req-1e07d50f-a4fe-4670-ad48-b52689bce874 tempest-TestMinimumBasicScenario-1144717405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:30:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-54541b62-4b13-4302-9c41-c82d35e78d81 req-1e07d50f-a4fe-4670-ad48-b52689bce874 tempest-TestMinimumBasicScenario-1144717405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:30:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-54541b62-4b13-4302-9c41-c82d35e78d81 req-1e07d50f-a4fe-4670-ad48-b52689bce874 tempest-TestMinimumBasicScenario-1144717405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:30:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-54541b62-4b13-4302-9c41-c82d35e78d81 req-1e07d50f-a4fe-4670-ad48-b52689bce874 tempest-TestMinimumBasicScenario-1144717405 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049', 'name': 'volume-d972cf46-720a-4ef1-99fe-8559a7b1b14a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0ca1e591-d508-4d4d-a2cd-ebcb4480e291', 'enforce_multipath': True} {{(pid=86893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 08:30:23 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-54541b62-4b13-4302-9c41-c82d35e78d81 req-1e07d50f-a4fe-4670-ad48-b52689bce874 tempest-TestMinimumBasicScenario-1144717405 None] attachment_update completed successfully. Sep 01 08:30:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:30:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:30:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:30:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:30:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:30:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:30:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:30:31 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:30:31 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:30:31 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Sep 01 08:30:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.266s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:30:31 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:30:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager._thread_info {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:30:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread count: 28 {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 08:30:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread info: [<_MainThread(MainThread, started 138934582050944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 08:30:33 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:30:33 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=9,cinder:UPDATE=9 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:31:11 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-541f566e-f3fc-4b9e-a138-0260252029fe req-e9adabd2-2451-4153-98fa-967cf2fedef0 tempest-TestMinimumBasicScenario-1144717405 None] Terminate volume connection completed successfully. Sep 01 08:31:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-541f566e-f3fc-4b9e-a138-0260252029fe req-e9adabd2-2451-4153-98fa-967cf2fedef0 tempest-TestMinimumBasicScenario-1144717405 None] Deleting attachment 0ca1e591-d508-4d4d-a2cd-ebcb4480e291. {{(pid=86893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 08:31:12 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b4dd6989-7899-467e-9c7a-f46fc04070af tempest-TestMinimumBasicScenario-1144717405 None] Acquiring lock "cinder-d972cf46-720a-4ef1-99fe-8559a7b1b14a-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:31:12 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b4dd6989-7899-467e-9c7a-f46fc04070af tempest-TestMinimumBasicScenario-1144717405 None] Lock "cinder-d972cf46-720a-4ef1-99fe-8559a7b1b14a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:31:12 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b4dd6989-7899-467e-9c7a-f46fc04070af tempest-TestMinimumBasicScenario-1144717405 None] Acquiring lock "cinder-quobyte-d972cf46-720a-4ef1-99fe-8559a7b1b14a" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:31:12 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b4dd6989-7899-467e-9c7a-f46fc04070af tempest-TestMinimumBasicScenario-1144717405 None] Lock "cinder-quobyte-d972cf46-720a-4ef1-99fe-8559a7b1b14a" acquired by "delete_volume" :: waited 0.014s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:31:12 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9eb2866-66a2-4b10-bf10-7736be203893]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:31:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b4dd6989-7899-467e-9c7a-f46fc04070af tempest-TestMinimumBasicScenario-1144717405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d972cf46-720a-4ef1-99fe-8559a7b1b14a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:31:12 devstack sudo[103681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d972cf46-720a-4ef1-99fe-8559a7b1b14a Sep 01 08:31:12 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:31:12 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root Sep 01 08:31:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b4dd6989-7899-467e-9c7a-f46fc04070af tempest-TestMinimumBasicScenario-1144717405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d972cf46-720a-4ef1-99fe-8559a7b1b14a" returned: 0 in 0.350s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:31:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b4dd6989-7899-467e-9c7a-f46fc04070af tempest-TestMinimumBasicScenario-1144717405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d972cf46-720a-4ef1-99fe-8559a7b1b14a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:31:13 devstack sudo[103686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d972cf46-720a-4ef1-99fe-8559a7b1b14a Sep 01 08:31:13 devstack sudo[103686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:31:13 devstack sudo[103686]: pam_unix(sudo:session): session closed for user root Sep 01 08:31:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b4dd6989-7899-467e-9c7a-f46fc04070af tempest-TestMinimumBasicScenario-1144717405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-d972cf46-720a-4ef1-99fe-8559a7b1b14a" returned: 0 in 0.243s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:31:13 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b4dd6989-7899-467e-9c7a-f46fc04070af tempest-TestMinimumBasicScenario-1144717405 None] Lock "cinder-quobyte-d972cf46-720a-4ef1-99fe-8559a7b1b14a" released by "delete_volume" :: held 0.631s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:31:13 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-b4dd6989-7899-467e-9c7a-f46fc04070af tempest-TestMinimumBasicScenario-1144717405 None] Created reservations ['daf80ed8-0390-4543-92c4-e2868736e4d6', 'd3778b46-38ec-4de1-8f14-e4a07d5756e6', '9c88fe66-7b76-4f4e-9095-6d3c176a483b', '2022547a-9af4-448a-9bda-72d591e8b1a6'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:31:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b4dd6989-7899-467e-9c7a-f46fc04070af tempest-TestMinimumBasicScenario-1144717405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:31:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b4dd6989-7899-467e-9c7a-f46fc04070af tempest-TestMinimumBasicScenario-1144717405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:31:13 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b4dd6989-7899-467e-9c7a-f46fc04070af tempest-TestMinimumBasicScenario-1144717405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:31:13 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b4dd6989-7899-467e-9c7a-f46fc04070af tempest-TestMinimumBasicScenario-1144717405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:31:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b4dd6989-7899-467e-9c7a-f46fc04070af tempest-TestMinimumBasicScenario-1144717405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:31:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b4dd6989-7899-467e-9c7a-f46fc04070af tempest-TestMinimumBasicScenario-1144717405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:31:13 devstack sudo[103689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:31:13 devstack sudo[103689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:31:13 devstack sudo[103689]: pam_unix(sudo:session): session closed for user root Sep 01 08:31:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b4dd6989-7899-467e-9c7a-f46fc04070af tempest-TestMinimumBasicScenario-1144717405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.242s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:31:13 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-b4dd6989-7899-467e-9c7a-f46fc04070af tempest-TestMinimumBasicScenario-1144717405 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:31:13 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-b4dd6989-7899-467e-9c7a-f46fc04070af tempest-TestMinimumBasicScenario-1144717405 None] Deleted volume successfully. Sep 01 08:31:13 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b4dd6989-7899-467e-9c7a-f46fc04070af tempest-TestMinimumBasicScenario-1144717405 None] Lock "cinder-d972cf46-720a-4ef1-99fe-8559a7b1b14a-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:31:23 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=5,cinder:UPDATE=9,cinder:INSERT=3 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:31:23 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:31:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:31:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:31:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:31:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:31:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:31:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:31:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:31:31 devstack sudo[103726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:31:31 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:31:31 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root Sep 01 08:31:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.276s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:31:31 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:31:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager._thread_info {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:31:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread count: 28 {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 08:31:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread info: [<_MainThread(MainThread, started 138934582050944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 08:31:48 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:31:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Flow 'volume_create_manager' (35c3dcea-18be-45f5-9b7b-d0c661f8fdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:31:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a377d141-22da-44ec-8362-2e0447e97356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:31:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a377d141-22da-44ec-8362-2e0447e97356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1730648529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd8d193-e92e-4326-9e30-c4b5a2b14b9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23463ccddb4648fda6857d91959ae807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:31:48Z,use_quota=True,user_id='246a59fd244a47f8beb571d4b3a07c88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:31:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4393bb6-cea7-49b2-b28d-36967dc7d534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:31:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4393bb6-cea7-49b2-b28d-36967dc7d534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:31:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e99b83a-5470-433f-940b-bea11a9cb6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:31:48 devstack cinder-volume[86893]: DEBUG cinder.image.glance [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Creating Keystone auth plugin from conf {{(pid=86893) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 08:31:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e99b83a-5470-433f-940b-bea11a9cb6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0bd8d193-e92e-4326-9e30-c4b5a2b14b9a', 'volume_name': 'volume-0bd8d193-e92e-4326-9e30-c4b5a2b14b9a', 'volume_size': 1, 'image_id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a80c3dd0151a4e4aacd690bfb315fb01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'created_at': datetime.datetime(2026, 9, 1, 6, 7, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 6, 7, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:31:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d97afc-8dbd-42a8-ac40-2b46a27df877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:31:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d97afc-8dbd-42a8-ac40-2b46a27df877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:31:48 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecb18957-7fdd-4268-a0d9-004775e26660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:31:48 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Volume 0bd8d193-e92e-4326-9e30-c4b5a2b14b9a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0bd8d193-e92e-4326-9e30-c4b5a2b14b9a', 'volume_size': 1, 'image_id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a80c3dd0151a4e4aacd690bfb315fb01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'created_at': datetime.datetime(2026, 9, 1, 6, 7, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 6, 7, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 08:31:48 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Trying to clone 0bd8d193-e92e-4326-9e30-c4b5a2b14b9a from image 00f5a94d-dba5-4527-9ce8-7a00c3b29ced at location (None, [{'url': 'file:///opt/stack/data/glance/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'metadata': {}}]). {{(pid=86893) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1100}} Sep 01 08:31:49 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_lu3ul0njdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86893) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 08:31:49 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Image download 20.69 MB at 20.69 MB/s Sep 01 08:31:49 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e63c840-54f7-43ae-829b-f8780ab3de54]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:31:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_lu3ul0njdevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:31:49 devstack sudo[103734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_lu3ul0njdevstack@QuobyteHD Sep 01 08:31:49 devstack sudo[103734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:31:49 devstack sudo[103734]: pam_unix(sudo:session): session closed for user root Sep 01 08:31:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_lu3ul0njdevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:31:49 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Temporary image 00f5a94d-dba5-4527-9ce8-7a00c3b29ced is fetched for user 246a59fd244a47f8beb571d4b3a07c88. {{(pid=86893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 08:31:49 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[085d97df-300a-4f0f-a7d6-7961291e26a3]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:31:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_lu3ul0njdevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:31:49 devstack sudo[103739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_lu3ul0njdevstack@QuobyteHD Sep 01 08:31:49 devstack sudo[103739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:31:49 devstack sudo[103739]: pam_unix(sudo:session): session closed for user root Sep 01 08:31:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_lu3ul0njdevstack@QuobyteHD" returned: 0 in 0.317s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:31:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:31:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:31:49 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1730648529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd8d193-e92e-4326-9e30-c4b5a2b14b9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23463ccddb4648fda6857d91959ae807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:31:48Z,use_quota=True,user_id='246a59fd244a47f8beb571d4b3a07c88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:31:49 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Creating volume 0bd8d193-e92e-4326-9e30-c4b5a2b14b9a {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:31:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:31:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:31:49 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:31:49 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:31:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:31:49 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:31:49 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:31:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0bd8d193-e92e-4326-9e30-c4b5a2b14b9a 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:31:49 devstack sudo[103744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0bd8d193-e92e-4326-9e30-c4b5a2b14b9a 1073741824 Sep 01 08:31:49 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:31:50 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root Sep 01 08:31:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0bd8d193-e92e-4326-9e30-c4b5a2b14b9a 1073741824" returned: 0 in 0.385s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:31:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0bd8d193-e92e-4326-9e30-c4b5a2b14b9a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:31:50 devstack sudo[103749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0bd8d193-e92e-4326-9e30-c4b5a2b14b9a Sep 01 08:31:50 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:31:50 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root Sep 01 08:31:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0bd8d193-e92e-4326-9e30-c4b5a2b14b9a" returned: 0 in 0.251s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:31:50 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:31:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:31:50 devstack cinder-volume[86893]: DEBUG cinder.volume.volume_utils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Attempting download of 00f5a94d-dba5-4527-9ce8-7a00c3b29ced ((None, [{'url': 'file:///opt/stack/data/glance/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'metadata': {}}])) to volume 0bd8d193-e92e-4326-9e30-c4b5a2b14b9a. {{(pid=86893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 08:31:50 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe98216-d821-4cac-be8b-9143317a32cd]: (4, 'raw') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:31:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_0n7spxgo {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:31:50 devstack sudo[103752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_0n7spxgo Sep 01 08:31:50 devstack sudo[103752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:31:50 devstack sudo[103752]: pam_unix(sudo:session): session closed for user root Sep 01 08:31:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_0n7spxgo" returned: 0 in 0.314s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:31:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_0n7spxgo {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:31:51 devstack sudo[103756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_0n7spxgo Sep 01 08:31:51 devstack sudo[103756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:31:51 devstack sudo[103756]: pam_unix(sudo:session): session closed for user root Sep 01 08:31:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_0n7spxgo" returned: 1 in 0.309s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:31:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_0n7spxgo' failed. Not Retrying. {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 08:31:51 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb9ea8a-d1f3-48f7-ae7b-654191e03447]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:31:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_lu3ul0njdevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:31:51 devstack sudo[103760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_lu3ul0njdevstack@QuobyteHD Sep 01 08:31:51 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:31:51 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root Sep 01 08:31:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_lu3ul0njdevstack@QuobyteHD" returned: 0 in 0.311s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:31:51 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] 00f5a94d-dba5-4527-9ce8-7a00c3b29ced was qcow2, converting to qcow2 {{(pid=86893) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 08:31:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_lu3ul0njdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0bd8d193-e92e-4326-9e30-c4b5a2b14b9a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:31:51 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_lu3ul0njdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0bd8d193-e92e-4326-9e30-c4b5a2b14b9a Sep 01 08:31:51 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:31:53 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Sep 01 08:31:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_lu3ul0njdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0bd8d193-e92e-4326-9e30-c4b5a2b14b9a" returned: 0 in 1.536s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:31:53 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_00f5a94d-dba5-4527-9ce8-7a00c3b29ced_lu3ul0njdevstack@QuobyteHD, size 112.00 MB, duration 1.54 sec, destination /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0bd8d193-e92e-4326-9e30-c4b5a2b14b9a {{(pid=86893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 08:31:53 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Converted 112.00 MB image at 72.86 MB/s Sep 01 08:31:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0bd8d193-e92e-4326-9e30-c4b5a2b14b9a 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:31:53 devstack sudo[103775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0bd8d193-e92e-4326-9e30-c4b5a2b14b9a 1G Sep 01 08:31:53 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:31:53 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root Sep 01 08:31:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0bd8d193-e92e-4326-9e30-c4b5a2b14b9a 1G" returned: 0 in 0.296s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:31:53 devstack cinder-volume[86893]: DEBUG cinder.volume.volume_utils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Downloaded image 00f5a94d-dba5-4527-9ce8-7a00c3b29ced ((None, [{'url': 'file:///opt/stack/data/glance/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'metadata': {}}])) to volume 0bd8d193-e92e-4326-9e30-c4b5a2b14b9a successfully. {{(pid=86893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 08:31:53 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Temporary image 00f5a94d-dba5-4527-9ce8-7a00c3b29ced for user 246a59fd244a47f8beb571d4b3a07c88 is deleted. {{(pid=86893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 08:31:53 devstack cinder-volume[86893]: DEBUG cinder.volume.volume_utils [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Marking volume 0bd8d193-e92e-4326-9e30-c4b5a2b14b9a as bootable. {{(pid=86893) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 08:31:53 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Copying metadata from image 00f5a94d-dba5-4527-9ce8-7a00c3b29ced to 0bd8d193-e92e-4326-9e30-c4b5a2b14b9a. {{(pid=86893) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 08:31:53 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Creating volume glance metadata for volume 0bd8d193-e92e-4326-9e30-c4b5a2b14b9a backed by image 00f5a94d-dba5-4527-9ce8-7a00c3b29ced with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86893) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 08:31:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecb18957-7fdd-4268-a0d9-004775e26660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bd8d193-e92e-4326-9e30-c4b5a2b14b9a', 'volume_size': 1, 'image_id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a80c3dd0151a4e4aacd690bfb315fb01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '00f5a94d-dba5-4527-9ce8-7a00c3b29ced', 'created_at': datetime.datetime(2026, 9, 1, 6, 7, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 6, 7, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00f5a94d-dba5-4527-9ce8-7a00c3b29ced/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:31:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf6bd40e-1033-4556-8a6c-5b1f17c33226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:31:53 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Volume volume-0bd8d193-e92e-4326-9e30-c4b5a2b14b9a (0bd8d193-e92e-4326-9e30-c4b5a2b14b9a): created successfully Sep 01 08:31:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf6bd40e-1033-4556-8a6c-5b1f17c33226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:31:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Flow 'volume_create_manager' (35c3dcea-18be-45f5-9b7b-d0c661f8fdec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:31:53 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-1700b314-43e1-4731-99a7-0ec9e8586b5e tempest-TestShelveInstance-509250 None] Created volume successfully. Sep 01 08:31:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-e6caa304-872e-42cb-a9ce-4184de4efe71 req-2a73ec44-fa43-4337-aac2-decd1cb9fad2 tempest-TestShelveInstance-509250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:31:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-e6caa304-872e-42cb-a9ce-4184de4efe71 req-2a73ec44-fa43-4337-aac2-decd1cb9fad2 tempest-TestShelveInstance-509250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:31:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-e6caa304-872e-42cb-a9ce-4184de4efe71 req-2a73ec44-fa43-4337-aac2-decd1cb9fad2 tempest-TestShelveInstance-509250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:31:56 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-e6caa304-872e-42cb-a9ce-4184de4efe71 req-2a73ec44-fa43-4337-aac2-decd1cb9fad2 tempest-TestShelveInstance-509250 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049', 'name': 'volume-0bd8d193-e92e-4326-9e30-c4b5a2b14b9a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ae29e629-2ca9-491d-a25b-ff9ad8670e7f', 'enforce_multipath': True} {{(pid=86893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 08:31:56 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-e6caa304-872e-42cb-a9ce-4184de4efe71 req-2a73ec44-fa43-4337-aac2-decd1cb9fad2 tempest-TestShelveInstance-509250 None] attachment_update completed successfully. Sep 01 08:32:06 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=16,cinder:INSERT=7,cinder:UPDATE=6 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:32:06 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:UPDATE=6,cinder:SELECT=16,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:32:27 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-09ecf0fe-b4a3-4eac-867c-f123ce7be9dc req-5e68f3ab-53e3-46d4-a592-75d8daf2cfe9 tempest-TestShelveInstance-509250 None] Terminate volume connection completed successfully. Sep 01 08:32:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-09ecf0fe-b4a3-4eac-867c-f123ce7be9dc req-5e68f3ab-53e3-46d4-a592-75d8daf2cfe9 tempest-TestShelveInstance-509250 None] Deleting attachment ae29e629-2ca9-491d-a25b-ff9ad8670e7f. {{(pid=86893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 08:32:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-238ec708-288a-40e6-adf5-74d22d676915 req-67def293-c2ac-4661-8bd4-4154b8367d10 tempest-TestShelveInstance-509250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:32:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-238ec708-288a-40e6-adf5-74d22d676915 req-67def293-c2ac-4661-8bd4-4154b8367d10 tempest-TestShelveInstance-509250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:32:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-238ec708-288a-40e6-adf5-74d22d676915 req-67def293-c2ac-4661-8bd4-4154b8367d10 tempest-TestShelveInstance-509250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:32:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-238ec708-288a-40e6-adf5-74d22d676915 req-67def293-c2ac-4661-8bd4-4154b8367d10 tempest-TestShelveInstance-509250 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049', 'name': 'volume-0bd8d193-e92e-4326-9e30-c4b5a2b14b9a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b0035e67-e35c-40dc-8779-c591c670b21f', 'enforce_multipath': True} {{(pid=86893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 08:32:29 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-238ec708-288a-40e6-adf5-74d22d676915 req-67def293-c2ac-4661-8bd4-4154b8367d10 tempest-TestShelveInstance-509250 None] attachment_update completed successfully. Sep 01 08:32:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:32:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:32:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:32:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:32:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:32:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:32:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:32:31 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:32:31 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:32:31 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Sep 01 08:32:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.252s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:32:31 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:32:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager._thread_info {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:32:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread count: 28 {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 08:32:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread info: [<_MainThread(MainThread, started 138934582050944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 08:32:39 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:UPDATE=1,cinder:SELECT=7 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:32:39 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:33:12 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-70447993-1246-4db5-a276-b08c226ce127 req-46f5267d-9e22-4a9e-9e8f-370c21181839 tempest-TestShelveInstance-509250 None] Terminate volume connection completed successfully. Sep 01 08:33:12 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [req-70447993-1246-4db5-a276-b08c226ce127 req-46f5267d-9e22-4a9e-9e8f-370c21181839 tempest-TestShelveInstance-509250 None] Deleting attachment b0035e67-e35c-40dc-8779-c591c670b21f. {{(pid=86893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 08:33:12 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-70447993-1246-4db5-a276-b08c226ce127 req-ba063a25-30bd-4ca5-96e3-bbb0f3eb9f1d tempest-TestShelveInstance-509250 None] Acquiring lock "cinder-0bd8d193-e92e-4326-9e30-c4b5a2b14b9a-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:33:12 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-70447993-1246-4db5-a276-b08c226ce127 req-ba063a25-30bd-4ca5-96e3-bbb0f3eb9f1d tempest-TestShelveInstance-509250 None] Lock "cinder-0bd8d193-e92e-4326-9e30-c4b5a2b14b9a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:33:12 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-70447993-1246-4db5-a276-b08c226ce127 req-ba063a25-30bd-4ca5-96e3-bbb0f3eb9f1d tempest-TestShelveInstance-509250 None] Acquiring lock "cinder-quobyte-0bd8d193-e92e-4326-9e30-c4b5a2b14b9a" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:33:12 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-70447993-1246-4db5-a276-b08c226ce127 req-ba063a25-30bd-4ca5-96e3-bbb0f3eb9f1d tempest-TestShelveInstance-509250 None] Lock "cinder-quobyte-0bd8d193-e92e-4326-9e30-c4b5a2b14b9a" acquired by "delete_volume" :: waited 0.019s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:33:12 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d550e4e-39a8-4034-9c1e-f89a77edce0a]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:33:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-70447993-1246-4db5-a276-b08c226ce127 req-ba063a25-30bd-4ca5-96e3-bbb0f3eb9f1d tempest-TestShelveInstance-509250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0bd8d193-e92e-4326-9e30-c4b5a2b14b9a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:12 devstack sudo[104936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0bd8d193-e92e-4326-9e30-c4b5a2b14b9a Sep 01 08:33:12 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:12 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-70447993-1246-4db5-a276-b08c226ce127 req-ba063a25-30bd-4ca5-96e3-bbb0f3eb9f1d tempest-TestShelveInstance-509250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0bd8d193-e92e-4326-9e30-c4b5a2b14b9a" returned: 0 in 0.413s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-70447993-1246-4db5-a276-b08c226ce127 req-ba063a25-30bd-4ca5-96e3-bbb0f3eb9f1d tempest-TestShelveInstance-509250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0bd8d193-e92e-4326-9e30-c4b5a2b14b9a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:12 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0bd8d193-e92e-4326-9e30-c4b5a2b14b9a Sep 01 08:33:12 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:13 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-70447993-1246-4db5-a276-b08c226ce127 req-ba063a25-30bd-4ca5-96e3-bbb0f3eb9f1d tempest-TestShelveInstance-509250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0bd8d193-e92e-4326-9e30-c4b5a2b14b9a" returned: 0 in 0.254s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:13 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-70447993-1246-4db5-a276-b08c226ce127 req-ba063a25-30bd-4ca5-96e3-bbb0f3eb9f1d tempest-TestShelveInstance-509250 None] Lock "cinder-quobyte-0bd8d193-e92e-4326-9e30-c4b5a2b14b9a" released by "delete_volume" :: held 0.713s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:33:13 devstack cinder-volume[86893]: DEBUG cinder.quota [req-70447993-1246-4db5-a276-b08c226ce127 req-ba063a25-30bd-4ca5-96e3-bbb0f3eb9f1d tempest-TestShelveInstance-509250 None] Created reservations ['19e57af7-43b4-4575-967d-57ccdd43155c', '2bbbc247-e11a-436f-88dc-19980a3fdfd4', 'cd949d6a-925a-4d38-956c-07c6152f9156', '3a29b111-7103-4dea-b25b-296c0d5d9b08'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:33:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-70447993-1246-4db5-a276-b08c226ce127 req-ba063a25-30bd-4ca5-96e3-bbb0f3eb9f1d tempest-TestShelveInstance-509250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:33:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-70447993-1246-4db5-a276-b08c226ce127 req-ba063a25-30bd-4ca5-96e3-bbb0f3eb9f1d tempest-TestShelveInstance-509250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:33:13 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [req-70447993-1246-4db5-a276-b08c226ce127 req-ba063a25-30bd-4ca5-96e3-bbb0f3eb9f1d tempest-TestShelveInstance-509250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:33:13 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [req-70447993-1246-4db5-a276-b08c226ce127 req-ba063a25-30bd-4ca5-96e3-bbb0f3eb9f1d tempest-TestShelveInstance-509250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:33:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [req-70447993-1246-4db5-a276-b08c226ce127 req-ba063a25-30bd-4ca5-96e3-bbb0f3eb9f1d tempest-TestShelveInstance-509250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:33:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-70447993-1246-4db5-a276-b08c226ce127 req-ba063a25-30bd-4ca5-96e3-bbb0f3eb9f1d tempest-TestShelveInstance-509250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:13 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:33:13 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:13 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [req-70447993-1246-4db5-a276-b08c226ce127 req-ba063a25-30bd-4ca5-96e3-bbb0f3eb9f1d tempest-TestShelveInstance-509250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.271s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:13 devstack cinder-volume[86893]: DEBUG cinder.manager [req-70447993-1246-4db5-a276-b08c226ce127 req-ba063a25-30bd-4ca5-96e3-bbb0f3eb9f1d tempest-TestShelveInstance-509250 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:33:13 devstack cinder-volume[86893]: INFO cinder.volume.manager [req-70447993-1246-4db5-a276-b08c226ce127 req-ba063a25-30bd-4ca5-96e3-bbb0f3eb9f1d tempest-TestShelveInstance-509250 None] Deleted volume successfully. Sep 01 08:33:13 devstack cinder-volume[86893]: DEBUG cinder.coordination [req-70447993-1246-4db5-a276-b08c226ce127 req-ba063a25-30bd-4ca5-96e3-bbb0f3eb9f1d tempest-TestShelveInstance-509250 None] Lock "cinder-0bd8d193-e92e-4326-9e30-c4b5a2b14b9a-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:33:23 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:33:23 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=6,cinder:UPDATE=10,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:33:24 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:33:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Flow 'volume_create_manager' (21733642-5904-4c01-8bcc-566b56739f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:33:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47a6da5-6dc9-45de-8b73-079fd7745aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47a6da5-6dc9-45de-8b73-079fd7745aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-664280985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40761f37-48b5-44ca-b3c9-cd32dfffc644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ed4ba6dfc94be79184c2046e106fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:33:25Z,use_quota=True,user_id='f33c2ca1394f4dc5b38a23128ce55eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41c13a0-0979-44bb-9da6-8bf6ca748694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41c13a0-0979-44bb-9da6-8bf6ca748694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b2699c-c668-4753-9bbf-50d4150b0f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b2699c-c668-4753-9bbf-50d4150b0f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40761f37-48b5-44ca-b3c9-cd32dfffc644', 'volume_name': 'volume-40761f37-48b5-44ca-b3c9-cd32dfffc644', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c90293f-94ac-41a7-98ea-1f1c9f0891f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c90293f-94ac-41a7-98ea-1f1c9f0891f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:24 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (963cbe44-6747-45d9-a4f2-710179645fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:24 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Volume 40761f37-48b5-44ca-b3c9-cd32dfffc644: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40761f37-48b5-44ca-b3c9-cd32dfffc644', 'volume_size': 1} Sep 01 08:33:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:33:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:33:24 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-664280985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40761f37-48b5-44ca-b3c9-cd32dfffc644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ed4ba6dfc94be79184c2046e106fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:33:25Z,use_quota=True,user_id='f33c2ca1394f4dc5b38a23128ce55eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:33:24 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Creating volume 40761f37-48b5-44ca-b3c9-cd32dfffc644 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:33:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:33:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:33:24 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:33:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:33:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:33:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:33:25 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:33:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-40761f37-48b5-44ca-b3c9-cd32dfffc644 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:25 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-40761f37-48b5-44ca-b3c9-cd32dfffc644 1073741824 Sep 01 08:33:25 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:25 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-40761f37-48b5-44ca-b3c9-cd32dfffc644 1073741824" returned: 0 in 0.396s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-40761f37-48b5-44ca-b3c9-cd32dfffc644 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:25 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-40761f37-48b5-44ca-b3c9-cd32dfffc644 Sep 01 08:33:25 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:25 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-40761f37-48b5-44ca-b3c9-cd32dfffc644" returned: 0 in 0.248s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:33:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:33:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (963cbe44-6747-45d9-a4f2-710179645fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40761f37-48b5-44ca-b3c9-cd32dfffc644', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe1d179-ee87-47d8-8fef-2d196db8033c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:25 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Volume volume-40761f37-48b5-44ca-b3c9-cd32dfffc644 (40761f37-48b5-44ca-b3c9-cd32dfffc644): created successfully Sep 01 08:33:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe1d179-ee87-47d8-8fef-2d196db8033c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Flow 'volume_create_manager' (21733642-5904-4c01-8bcc-566b56739f47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:33:25 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-4caf47b6-41c5-42d7-b729-f34878aad778 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Created volume successfully. Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Flow 'volume_create_manager' (7d58f6ba-27f8-4a1d-a55f-7cf74e6e4b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6392fea9-9663-455d-966f-f2406232c82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6392fea9-9663-455d-966f-f2406232c82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-35054391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baeb79f8-a0d4-47ba-bcb8-32ce0fd2b555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ed4ba6dfc94be79184c2046e106fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:33:26Z,use_quota=True,user_id='f33c2ca1394f4dc5b38a23128ce55eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b17396-0299-4a0a-9387-fefa3eb5db8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b17396-0299-4a0a-9387-fefa3eb5db8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (887a9893-0cab-4c49-8e7d-8d9e297f0ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (887a9893-0cab-4c49-8e7d-8d9e297f0ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baeb79f8-a0d4-47ba-bcb8-32ce0fd2b555', 'volume_name': 'volume-baeb79f8-a0d4-47ba-bcb8-32ce0fd2b555', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7c19b71-fcaa-4ec7-abee-c1ec58a09999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7c19b71-fcaa-4ec7-abee-c1ec58a09999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2630750d-40b3-4ea7-a243-f0d308740a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:26 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Volume baeb79f8-a0d4-47ba-bcb8-32ce0fd2b555: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baeb79f8-a0d4-47ba-bcb8-32ce0fd2b555', 'volume_size': 1} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-35054391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baeb79f8-a0d4-47ba-bcb8-32ce0fd2b555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ed4ba6dfc94be79184c2046e106fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:33:26Z,use_quota=True,user_id='f33c2ca1394f4dc5b38a23128ce55eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Creating volume baeb79f8-a0d4-47ba-bcb8-32ce0fd2b555 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:33:26 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-baeb79f8-a0d4-47ba-bcb8-32ce0fd2b555 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:26 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-baeb79f8-a0d4-47ba-bcb8-32ce0fd2b555 1073741824 Sep 01 08:33:26 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Flow 'volume_create_manager' (4db958a3-92c4-4b56-9e01-62151ffc48a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50b9db18-45de-4268-9ec1-379acce98e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50b9db18-45de-4268-9ec1-379acce98e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1147764225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=015649d3-02b2-4546-b384-b59fc68febc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ed4ba6dfc94be79184c2046e106fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:33:27Z,use_quota=True,user_id='f33c2ca1394f4dc5b38a23128ce55eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f96b513b-d1d1-4236-90a7-06cfd855ded1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f96b513b-d1d1-4236-90a7-06cfd855ded1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30bca885-10cf-4ec7-a361-d72e6760833c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30bca885-10cf-4ec7-a361-d72e6760833c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '015649d3-02b2-4546-b384-b59fc68febc9', 'volume_name': 'volume-015649d3-02b2-4546-b384-b59fc68febc9', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62a7dfc6-bea1-4088-ba58-e9fdf848963e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62a7dfc6-bea1-4088-ba58-e9fdf848963e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a39f4a8c-b387-4e79-9854-58cd67bf1d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:26 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Volume 015649d3-02b2-4546-b384-b59fc68febc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-015649d3-02b2-4546-b384-b59fc68febc9', 'volume_size': 1} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:33:26 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-baeb79f8-a0d4-47ba-bcb8-32ce0fd2b555 1073741824" returned: 0 in 0.491s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-baeb79f8-a0d4-47ba-bcb8-32ce0fd2b555 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:27 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-baeb79f8-a0d4-47ba-bcb8-32ce0fd2b555 Sep 01 08:33:27 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Flow 'volume_create_manager' (fb9f22dd-ef53-450c-807f-0f6f13b48aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2573ed-bbe1-4f20-8345-fd0f2c9c1f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2573ed-bbe1-4f20-8345-fd0f2c9c1f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1492956233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4602a95f-fb8c-4bc3-ab0c-50b985813300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ed4ba6dfc94be79184c2046e106fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:33:27Z,use_quota=True,user_id='f33c2ca1394f4dc5b38a23128ce55eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (801a6969-8191-4f03-89df-cafc55f3566c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (801a6969-8191-4f03-89df-cafc55f3566c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90e2e8cc-b4b1-4e0a-8f6b-f5177bbc3ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90e2e8cc-b4b1-4e0a-8f6b-f5177bbc3ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4602a95f-fb8c-4bc3-ab0c-50b985813300', 'volume_name': 'volume-4602a95f-fb8c-4bc3-ab0c-50b985813300', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b50a79-028c-40eb-af30-e53295c5824a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b50a79-028c-40eb-af30-e53295c5824a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82b36aa-1823-42a3-8e1e-e3860562da0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:27 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Volume 4602a95f-fb8c-4bc3-ab0c-50b985813300: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4602a95f-fb8c-4bc3-ab0c-50b985813300', 'volume_size': 1} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:33:27 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-baeb79f8-a0d4-47ba-bcb8-32ce0fd2b555" returned: 0 in 0.291s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.400s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1147764225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=015649d3-02b2-4546-b384-b59fc68febc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ed4ba6dfc94be79184c2046e106fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:33:27Z,use_quota=True,user_id='f33c2ca1394f4dc5b38a23128ce55eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Creating volume 015649d3-02b2-4546-b384-b59fc68febc9 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:33:27 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-015649d3-02b2-4546-b384-b59fc68febc9 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2630750d-40b3-4ea7-a243-f0d308740a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baeb79f8-a0d4-47ba-bcb8-32ce0fd2b555', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adb74d0a-3b32-4ab7-80de-4eec24a6c9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:27 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-015649d3-02b2-4546-b384-b59fc68febc9 1073741824 Sep 01 08:33:27 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:27 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Volume volume-baeb79f8-a0d4-47ba-bcb8-32ce0fd2b555 (baeb79f8-a0d4-47ba-bcb8-32ce0fd2b555): created successfully Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adb74d0a-3b32-4ab7-80de-4eec24a6c9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Flow 'volume_create_manager' (7d58f6ba-27f8-4a1d-a55f-7cf74e6e4b54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:33:27 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-8ff05d95-ed83-4e30-b4b7-3868ca50c129 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Created volume successfully. Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Flow 'volume_create_manager' (b77b726b-cd9e-429e-b33a-5dc26fc9ceea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b418ea89-68db-4011-8722-d7bcea291d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b418ea89-68db-4011-8722-d7bcea291d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1911618857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d4d7e3-0ed4-4b1a-ada7-e0e8d87243fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ed4ba6dfc94be79184c2046e106fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:33:28Z,use_quota=True,user_id='f33c2ca1394f4dc5b38a23128ce55eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa3a3f3d-83c8-4e1a-873e-b9aa508def0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa3a3f3d-83c8-4e1a-873e-b9aa508def0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72033954-8143-4dd4-afe5-173dbb5f2943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72033954-8143-4dd4-afe5-173dbb5f2943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47d4d7e3-0ed4-4b1a-ada7-e0e8d87243fc', 'volume_name': 'volume-47d4d7e3-0ed4-4b1a-ada7-e0e8d87243fc', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c230a91-bb5b-4118-b760-e2ef742023bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c230a91-bb5b-4118-b760-e2ef742023bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a059ea0f-e056-4546-8e70-e7095cf524e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:27 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Volume 47d4d7e3-0ed4-4b1a-ada7-e0e8d87243fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47d4d7e3-0ed4-4b1a-ada7-e0e8d87243fc', 'volume_size': 1} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:33:27 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-015649d3-02b2-4546-b384-b59fc68febc9 1073741824" returned: 0 in 0.496s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-015649d3-02b2-4546-b384-b59fc68febc9 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:27 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-015649d3-02b2-4546-b384-b59fc68febc9 Sep 01 08:33:27 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Flow 'volume_create_manager' (292f7597-c44b-48ad-965a-4d25e9f90c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a082e5f-ba0d-49cb-9e0c-fcae15255be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a082e5f-ba0d-49cb-9e0c-fcae15255be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-660067736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8d662eb-55d6-4f31-b86f-c4bc040b5979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ed4ba6dfc94be79184c2046e106fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:33:28Z,use_quota=True,user_id='f33c2ca1394f4dc5b38a23128ce55eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c3f9c6-0fc4-4fe3-ba7a-dc7612f55f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c3f9c6-0fc4-4fe3-ba7a-dc7612f55f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d7db95-9c64-4d54-8c64-ae9d02066d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d7db95-9c64-4d54-8c64-ae9d02066d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8d662eb-55d6-4f31-b86f-c4bc040b5979', 'volume_name': 'volume-e8d662eb-55d6-4f31-b86f-c4bc040b5979', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f3b1676-3d65-4315-8269-4f4f75064dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f3b1676-3d65-4315-8269-4f4f75064dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (651d6bb2-c865-48e8-a608-cbd14f598beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:27 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Volume e8d662eb-55d6-4f31-b86f-c4bc040b5979: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8d662eb-55d6-4f31-b86f-c4bc040b5979', 'volume_size': 1} Sep 01 08:33:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:33:28 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-015649d3-02b2-4546-b384-b59fc68febc9" returned: 0 in 0.250s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.841s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1492956233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4602a95f-fb8c-4bc3-ab0c-50b985813300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ed4ba6dfc94be79184c2046e106fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:33:27Z,use_quota=True,user_id='f33c2ca1394f4dc5b38a23128ce55eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Creating volume 4602a95f-fb8c-4bc3-ab0c-50b985813300 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:33:28 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4602a95f-fb8c-4bc3-ab0c-50b985813300 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a39f4a8c-b387-4e79-9854-58cd67bf1d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-015649d3-02b2-4546-b384-b59fc68febc9', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:28 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4602a95f-fb8c-4bc3-ab0c-50b985813300 1073741824 Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b67bc596-2e50-4f10-a994-252855c21d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:28 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:28 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Volume volume-015649d3-02b2-4546-b384-b59fc68febc9 (015649d3-02b2-4546-b384-b59fc68febc9): created successfully Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b67bc596-2e50-4f10-a994-252855c21d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Flow 'volume_create_manager' (4db958a3-92c4-4b56-9e01-62151ffc48a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:33:28 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-a69851d3-da5f-46ce-b797-39ec3cff70cf tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Created volume successfully. Sep 01 08:33:28 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4602a95f-fb8c-4bc3-ab0c-50b985813300 1073741824" returned: 0 in 0.390s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4602a95f-fb8c-4bc3-ab0c-50b985813300 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:28 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4602a95f-fb8c-4bc3-ab0c-50b985813300 Sep 01 08:33:28 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:28 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4602a95f-fb8c-4bc3-ab0c-50b985813300" returned: 0 in 0.243s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.083s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1911618857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d4d7e3-0ed4-4b1a-ada7-e0e8d87243fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ed4ba6dfc94be79184c2046e106fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:33:28Z,use_quota=True,user_id='f33c2ca1394f4dc5b38a23128ce55eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Creating volume 47d4d7e3-0ed4-4b1a-ada7-e0e8d87243fc {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:33:28 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-47d4d7e3-0ed4-4b1a-ada7-e0e8d87243fc 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82b36aa-1823-42a3-8e1e-e3860562da0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4602a95f-fb8c-4bc3-ab0c-50b985813300', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:28 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-47d4d7e3-0ed4-4b1a-ada7-e0e8d87243fc 1073741824 Sep 01 08:33:28 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58587ccb-c53e-4a05-bc91-f743ff79f44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:28 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Volume volume-4602a95f-fb8c-4bc3-ab0c-50b985813300 (4602a95f-fb8c-4bc3-ab0c-50b985813300): created successfully Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58587ccb-c53e-4a05-bc91-f743ff79f44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:28 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Flow 'volume_create_manager' (fb9f22dd-ef53-450c-807f-0f6f13b48aac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:33:28 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-2de5e537-67c6-4cbf-9da9-e9fe4273255f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Created volume successfully. Sep 01 08:33:29 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-47d4d7e3-0ed4-4b1a-ada7-e0e8d87243fc 1073741824" returned: 0 in 0.408s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-47d4d7e3-0ed4-4b1a-ada7-e0e8d87243fc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:29 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-47d4d7e3-0ed4-4b1a-ada7-e0e8d87243fc Sep 01 08:33:29 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:29 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-47d4d7e3-0ed4-4b1a-ada7-e0e8d87243fc" returned: 0 in 0.238s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:33:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:33:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.486s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:33:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-660067736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8d662eb-55d6-4f31-b86f-c4bc040b5979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ed4ba6dfc94be79184c2046e106fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:33:28Z,use_quota=True,user_id='f33c2ca1394f4dc5b38a23128ce55eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:33:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Creating volume e8d662eb-55d6-4f31-b86f-c4bc040b5979 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:33:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:33:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:33:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:33:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:33:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:33:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:33:29 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:33:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e8d662eb-55d6-4f31-b86f-c4bc040b5979 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a059ea0f-e056-4546-8e70-e7095cf524e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47d4d7e3-0ed4-4b1a-ada7-e0e8d87243fc', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:29 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e8d662eb-55d6-4f31-b86f-c4bc040b5979 1073741824 Sep 01 08:33:29 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a01e433c-cf33-4e55-93cb-91627afd20d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:29 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Volume volume-47d4d7e3-0ed4-4b1a-ada7-e0e8d87243fc (47d4d7e3-0ed4-4b1a-ada7-e0e8d87243fc): created successfully Sep 01 08:33:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a01e433c-cf33-4e55-93cb-91627afd20d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Flow 'volume_create_manager' (b77b726b-cd9e-429e-b33a-5dc26fc9ceea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:33:29 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-d7880e28-f981-4ef2-a2da-24106a0aea9e tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Created volume successfully. Sep 01 08:33:29 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e8d662eb-55d6-4f31-b86f-c4bc040b5979 1073741824" returned: 0 in 0.404s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e8d662eb-55d6-4f31-b86f-c4bc040b5979 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:29 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e8d662eb-55d6-4f31-b86f-c4bc040b5979 Sep 01 08:33:29 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:30 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e8d662eb-55d6-4f31-b86f-c4bc040b5979" returned: 0 in 0.243s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:33:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:33:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (651d6bb2-c865-48e8-a608-cbd14f598beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8d662eb-55d6-4f31-b86f-c4bc040b5979', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c8e7f3-6c81-49cd-afba-a496f985b16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:30 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Volume volume-e8d662eb-55d6-4f31-b86f-c4bc040b5979 (e8d662eb-55d6-4f31-b86f-c4bc040b5979): created successfully Sep 01 08:33:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c8e7f3-6c81-49cd-afba-a496f985b16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Flow 'volume_create_manager' (292f7597-c44b-48ad-965a-4d25e9f90c21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:33:30 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-195c7b3a-9db9-4de3-90ed-c20cc97d9738 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Created volume successfully. Sep 01 08:33:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:33:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:33:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:33:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:33:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:33:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:33:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:31 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:33:31 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:31 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ff05c662-4b36-4ce6-99f6-3ee3da6320c5 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Acquiring lock "cinder-e8d662eb-55d6-4f31-b86f-c4bc040b5979-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:33:31 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ff05c662-4b36-4ce6-99f6-3ee3da6320c5 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "cinder-e8d662eb-55d6-4f31-b86f-c4bc040b5979-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:33:31 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ff05c662-4b36-4ce6-99f6-3ee3da6320c5 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Acquiring lock "cinder-quobyte-e8d662eb-55d6-4f31-b86f-c4bc040b5979" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:33:31 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ff05c662-4b36-4ce6-99f6-3ee3da6320c5 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "cinder-quobyte-e8d662eb-55d6-4f31-b86f-c4bc040b5979" acquired by "delete_volume" :: waited 0.015s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:33:31 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.262s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:31 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:33:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager._thread_info {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:33:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread count: 28 {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 08:33:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread info: [<_MainThread(MainThread, started 138934582050944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 08:33:31 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[f874ee0d-25a2-4827-b5cb-c221ef3605ef]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:33:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ff05c662-4b36-4ce6-99f6-3ee3da6320c5 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e8d662eb-55d6-4f31-b86f-c4bc040b5979 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:31 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e8d662eb-55d6-4f31-b86f-c4bc040b5979 Sep 01 08:33:31 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:31 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ff05c662-4b36-4ce6-99f6-3ee3da6320c5 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e8d662eb-55d6-4f31-b86f-c4bc040b5979" returned: 0 in 0.364s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ff05c662-4b36-4ce6-99f6-3ee3da6320c5 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e8d662eb-55d6-4f31-b86f-c4bc040b5979 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:31 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e8d662eb-55d6-4f31-b86f-c4bc040b5979 Sep 01 08:33:31 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:31 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ff05c662-4b36-4ce6-99f6-3ee3da6320c5 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e8d662eb-55d6-4f31-b86f-c4bc040b5979" returned: 0 in 0.243s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:31 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ff05c662-4b36-4ce6-99f6-3ee3da6320c5 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "cinder-quobyte-e8d662eb-55d6-4f31-b86f-c4bc040b5979" released by "delete_volume" :: held 0.652s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:33:32 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-ff05c662-4b36-4ce6-99f6-3ee3da6320c5 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Created reservations ['fa1e5d2a-8741-4944-82f9-95592b05660c', '51532613-6e1c-4cba-bf69-19f2b7c1b977', '5acf675b-f89b-473f-ad07-a5c1c8b2bbe7', '51f8b562-72e0-4b0c-902f-5a16710f1435'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:33:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ff05c662-4b36-4ce6-99f6-3ee3da6320c5 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:33:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ff05c662-4b36-4ce6-99f6-3ee3da6320c5 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:33:32 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ff05c662-4b36-4ce6-99f6-3ee3da6320c5 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:33:32 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ff05c662-4b36-4ce6-99f6-3ee3da6320c5 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:33:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ff05c662-4b36-4ce6-99f6-3ee3da6320c5 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:33:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ff05c662-4b36-4ce6-99f6-3ee3da6320c5 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:32 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:33:32 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:32 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ff05c662-4b36-4ce6-99f6-3ee3da6320c5 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.234s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:32 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-ff05c662-4b36-4ce6-99f6-3ee3da6320c5 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:33:32 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-ff05c662-4b36-4ce6-99f6-3ee3da6320c5 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Deleted volume successfully. Sep 01 08:33:32 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ff05c662-4b36-4ce6-99f6-3ee3da6320c5 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "cinder-e8d662eb-55d6-4f31-b86f-c4bc040b5979-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:33:32 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-15545b97-ae36-4b9b-9edc-7c0a43bde174 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Acquiring lock "cinder-47d4d7e3-0ed4-4b1a-ada7-e0e8d87243fc-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:33:32 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-15545b97-ae36-4b9b-9edc-7c0a43bde174 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "cinder-47d4d7e3-0ed4-4b1a-ada7-e0e8d87243fc-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:33:32 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-15545b97-ae36-4b9b-9edc-7c0a43bde174 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Acquiring lock "cinder-quobyte-47d4d7e3-0ed4-4b1a-ada7-e0e8d87243fc" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:33:32 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-15545b97-ae36-4b9b-9edc-7c0a43bde174 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "cinder-quobyte-47d4d7e3-0ed4-4b1a-ada7-e0e8d87243fc" acquired by "delete_volume" :: waited 0.013s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:33:32 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c5063d-cda1-4df8-9483-5ffbeee82991]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:33:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-15545b97-ae36-4b9b-9edc-7c0a43bde174 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-47d4d7e3-0ed4-4b1a-ada7-e0e8d87243fc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:32 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-47d4d7e3-0ed4-4b1a-ada7-e0e8d87243fc Sep 01 08:33:32 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:32 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-15545b97-ae36-4b9b-9edc-7c0a43bde174 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-47d4d7e3-0ed4-4b1a-ada7-e0e8d87243fc" returned: 0 in 0.351s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-15545b97-ae36-4b9b-9edc-7c0a43bde174 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-47d4d7e3-0ed4-4b1a-ada7-e0e8d87243fc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:32 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-47d4d7e3-0ed4-4b1a-ada7-e0e8d87243fc Sep 01 08:33:32 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:33 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-15545b97-ae36-4b9b-9edc-7c0a43bde174 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-47d4d7e3-0ed4-4b1a-ada7-e0e8d87243fc" returned: 0 in 0.242s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-15545b97-ae36-4b9b-9edc-7c0a43bde174 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "cinder-quobyte-47d4d7e3-0ed4-4b1a-ada7-e0e8d87243fc" released by "delete_volume" :: held 0.632s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:33:33 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-15545b97-ae36-4b9b-9edc-7c0a43bde174 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Created reservations ['46ee7dc0-9406-48f8-848c-4eaaad8a153b', '9f76c611-4491-4860-8acd-e74c1913340e', '3f3a8dfc-ee8f-4211-ae1f-618109ddafab', '547a4900-9708-4a7d-ba1c-eef1f974943b'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:33:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-15545b97-ae36-4b9b-9edc-7c0a43bde174 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:33:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-15545b97-ae36-4b9b-9edc-7c0a43bde174 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:33:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-15545b97-ae36-4b9b-9edc-7c0a43bde174 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:33:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-15545b97-ae36-4b9b-9edc-7c0a43bde174 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:33:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-15545b97-ae36-4b9b-9edc-7c0a43bde174 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:33:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-15545b97-ae36-4b9b-9edc-7c0a43bde174 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:33 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:33:33 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:33 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-15545b97-ae36-4b9b-9edc-7c0a43bde174 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.244s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:33 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-15545b97-ae36-4b9b-9edc-7c0a43bde174 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:33:33 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-15545b97-ae36-4b9b-9edc-7c0a43bde174 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Deleted volume successfully. Sep 01 08:33:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-15545b97-ae36-4b9b-9edc-7c0a43bde174 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "cinder-47d4d7e3-0ed4-4b1a-ada7-e0e8d87243fc-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:33:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f11d041e-f3fc-46c4-9009-f3a0d428135f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Acquiring lock "cinder-4602a95f-fb8c-4bc3-ab0c-50b985813300-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:33:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f11d041e-f3fc-46c4-9009-f3a0d428135f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "cinder-4602a95f-fb8c-4bc3-ab0c-50b985813300-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:33:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f11d041e-f3fc-46c4-9009-f3a0d428135f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Acquiring lock "cinder-quobyte-4602a95f-fb8c-4bc3-ab0c-50b985813300" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:33:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f11d041e-f3fc-46c4-9009-f3a0d428135f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "cinder-quobyte-4602a95f-fb8c-4bc3-ab0c-50b985813300" acquired by "delete_volume" :: waited 0.014s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:33:33 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3fc1cb-b129-4cd2-a039-8eb30e4e40fc]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:33:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f11d041e-f3fc-46c4-9009-f3a0d428135f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4602a95f-fb8c-4bc3-ab0c-50b985813300 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:33 devstack sudo[105035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4602a95f-fb8c-4bc3-ab0c-50b985813300 Sep 01 08:33:33 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:34 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f11d041e-f3fc-46c4-9009-f3a0d428135f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4602a95f-fb8c-4bc3-ab0c-50b985813300" returned: 0 in 0.384s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f11d041e-f3fc-46c4-9009-f3a0d428135f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4602a95f-fb8c-4bc3-ab0c-50b985813300 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:34 devstack sudo[105042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4602a95f-fb8c-4bc3-ab0c-50b985813300 Sep 01 08:33:34 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:34 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f11d041e-f3fc-46c4-9009-f3a0d428135f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4602a95f-fb8c-4bc3-ab0c-50b985813300" returned: 0 in 0.253s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:34 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f11d041e-f3fc-46c4-9009-f3a0d428135f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "cinder-quobyte-4602a95f-fb8c-4bc3-ab0c-50b985813300" released by "delete_volume" :: held 0.671s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:33:34 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-f11d041e-f3fc-46c4-9009-f3a0d428135f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Created reservations ['d486c780-9e2c-4ea6-a0ab-30371b55d742', 'd9140ec3-02b7-4d8c-a40e-a736bd6216d5', '2594f341-d7aa-40ed-a526-23bc15369189', 'df827ab5-ee63-4f53-b81b-4c523cf0d5fa'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:33:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f11d041e-f3fc-46c4-9009-f3a0d428135f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:33:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f11d041e-f3fc-46c4-9009-f3a0d428135f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:33:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f11d041e-f3fc-46c4-9009-f3a0d428135f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:33:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f11d041e-f3fc-46c4-9009-f3a0d428135f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:33:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f11d041e-f3fc-46c4-9009-f3a0d428135f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:33:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f11d041e-f3fc-46c4-9009-f3a0d428135f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:34 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:33:34 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:34 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f11d041e-f3fc-46c4-9009-f3a0d428135f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.238s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:34 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-f11d041e-f3fc-46c4-9009-f3a0d428135f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:33:34 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-f11d041e-f3fc-46c4-9009-f3a0d428135f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Deleted volume successfully. Sep 01 08:33:34 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f11d041e-f3fc-46c4-9009-f3a0d428135f tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "cinder-4602a95f-fb8c-4bc3-ab0c-50b985813300-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:33:34 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b9a0a9fe-cdb4-4cc7-895c-b444f94e2008 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Acquiring lock "cinder-015649d3-02b2-4546-b384-b59fc68febc9-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:33:34 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b9a0a9fe-cdb4-4cc7-895c-b444f94e2008 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "cinder-015649d3-02b2-4546-b384-b59fc68febc9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:33:34 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b9a0a9fe-cdb4-4cc7-895c-b444f94e2008 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Acquiring lock "cinder-quobyte-015649d3-02b2-4546-b384-b59fc68febc9" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:33:34 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b9a0a9fe-cdb4-4cc7-895c-b444f94e2008 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "cinder-quobyte-015649d3-02b2-4546-b384-b59fc68febc9" acquired by "delete_volume" :: waited 0.019s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:33:34 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df48cb1-da2b-4a78-a92d-e3a05aec2ddf]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:33:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b9a0a9fe-cdb4-4cc7-895c-b444f94e2008 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-015649d3-02b2-4546-b384-b59fc68febc9 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:34 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-015649d3-02b2-4546-b384-b59fc68febc9 Sep 01 08:33:34 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:35 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b9a0a9fe-cdb4-4cc7-895c-b444f94e2008 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-015649d3-02b2-4546-b384-b59fc68febc9" returned: 0 in 0.356s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b9a0a9fe-cdb4-4cc7-895c-b444f94e2008 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-015649d3-02b2-4546-b384-b59fc68febc9 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:35 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-015649d3-02b2-4546-b384-b59fc68febc9 Sep 01 08:33:35 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:35 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b9a0a9fe-cdb4-4cc7-895c-b444f94e2008 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-015649d3-02b2-4546-b384-b59fc68febc9" returned: 0 in 0.238s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b9a0a9fe-cdb4-4cc7-895c-b444f94e2008 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "cinder-quobyte-015649d3-02b2-4546-b384-b59fc68febc9" released by "delete_volume" :: held 0.629s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:33:35 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-b9a0a9fe-cdb4-4cc7-895c-b444f94e2008 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Created reservations ['bb7656cf-eae6-48af-9c56-e453ba46f7bc', 'f9017796-cfca-40c2-8de4-86cb44b6d548', '6d3ae5db-e80f-4457-ab61-be82572937c8', '5685c520-79a5-49c8-b70e-40da79b459d0'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:33:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b9a0a9fe-cdb4-4cc7-895c-b444f94e2008 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:33:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b9a0a9fe-cdb4-4cc7-895c-b444f94e2008 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:33:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b9a0a9fe-cdb4-4cc7-895c-b444f94e2008 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:33:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b9a0a9fe-cdb4-4cc7-895c-b444f94e2008 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:33:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b9a0a9fe-cdb4-4cc7-895c-b444f94e2008 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:33:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b9a0a9fe-cdb4-4cc7-895c-b444f94e2008 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:35 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:33:35 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:35 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b9a0a9fe-cdb4-4cc7-895c-b444f94e2008 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.243s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:35 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-b9a0a9fe-cdb4-4cc7-895c-b444f94e2008 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:33:35 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-b9a0a9fe-cdb4-4cc7-895c-b444f94e2008 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Deleted volume successfully. Sep 01 08:33:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b9a0a9fe-cdb4-4cc7-895c-b444f94e2008 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "cinder-015649d3-02b2-4546-b384-b59fc68febc9-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:33:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ef72f797-aeb2-47d7-80e1-b9babb2f3b2a tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Acquiring lock "cinder-baeb79f8-a0d4-47ba-bcb8-32ce0fd2b555-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:33:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ef72f797-aeb2-47d7-80e1-b9babb2f3b2a tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "cinder-baeb79f8-a0d4-47ba-bcb8-32ce0fd2b555-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:33:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ef72f797-aeb2-47d7-80e1-b9babb2f3b2a tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Acquiring lock "cinder-quobyte-baeb79f8-a0d4-47ba-bcb8-32ce0fd2b555" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:33:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ef72f797-aeb2-47d7-80e1-b9babb2f3b2a tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "cinder-quobyte-baeb79f8-a0d4-47ba-bcb8-32ce0fd2b555" acquired by "delete_volume" :: waited 0.013s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:33:35 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d60456-daea-438f-8a69-48acedd484f1]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:33:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ef72f797-aeb2-47d7-80e1-b9babb2f3b2a tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-baeb79f8-a0d4-47ba-bcb8-32ce0fd2b555 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:36 devstack sudo[105059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-baeb79f8-a0d4-47ba-bcb8-32ce0fd2b555 Sep 01 08:33:36 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:36 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ef72f797-aeb2-47d7-80e1-b9babb2f3b2a tempest-CreateVolumesFromSourceVolumeTest-582539604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-baeb79f8-a0d4-47ba-bcb8-32ce0fd2b555" returned: 0 in 0.360s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ef72f797-aeb2-47d7-80e1-b9babb2f3b2a tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-baeb79f8-a0d4-47ba-bcb8-32ce0fd2b555 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:36 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-baeb79f8-a0d4-47ba-bcb8-32ce0fd2b555 Sep 01 08:33:36 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:36 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ef72f797-aeb2-47d7-80e1-b9babb2f3b2a tempest-CreateVolumesFromSourceVolumeTest-582539604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-baeb79f8-a0d4-47ba-bcb8-32ce0fd2b555" returned: 0 in 0.249s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:36 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ef72f797-aeb2-47d7-80e1-b9babb2f3b2a tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "cinder-quobyte-baeb79f8-a0d4-47ba-bcb8-32ce0fd2b555" released by "delete_volume" :: held 0.642s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:33:36 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-ef72f797-aeb2-47d7-80e1-b9babb2f3b2a tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Created reservations ['5f7a6c08-dc54-46b0-bb3a-6e8d1e619608', 'aab04484-535d-4e49-82e3-2dd9546a7819', 'b3520cce-1d7b-4d5b-a0e2-ddb886637477', 'e31eecb5-d424-48f6-a1bd-a43e219321e9'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:33:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ef72f797-aeb2-47d7-80e1-b9babb2f3b2a tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:33:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ef72f797-aeb2-47d7-80e1-b9babb2f3b2a tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:33:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ef72f797-aeb2-47d7-80e1-b9babb2f3b2a tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:33:36 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ef72f797-aeb2-47d7-80e1-b9babb2f3b2a tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:33:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ef72f797-aeb2-47d7-80e1-b9babb2f3b2a tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:33:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ef72f797-aeb2-47d7-80e1-b9babb2f3b2a tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:36 devstack sudo[105067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:33:36 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:36 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ef72f797-aeb2-47d7-80e1-b9babb2f3b2a tempest-CreateVolumesFromSourceVolumeTest-582539604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.252s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:36 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-ef72f797-aeb2-47d7-80e1-b9babb2f3b2a tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:33:36 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-ef72f797-aeb2-47d7-80e1-b9babb2f3b2a tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Deleted volume successfully. Sep 01 08:33:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ef72f797-aeb2-47d7-80e1-b9babb2f3b2a tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "cinder-baeb79f8-a0d4-47ba-bcb8-32ce0fd2b555-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:33:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-35774d44-1fbb-48d3-8584-61f15d1691e6 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Acquiring lock "cinder-40761f37-48b5-44ca-b3c9-cd32dfffc644-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:33:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-35774d44-1fbb-48d3-8584-61f15d1691e6 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "cinder-40761f37-48b5-44ca-b3c9-cd32dfffc644-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:33:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-35774d44-1fbb-48d3-8584-61f15d1691e6 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Acquiring lock "cinder-quobyte-40761f37-48b5-44ca-b3c9-cd32dfffc644" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:33:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-35774d44-1fbb-48d3-8584-61f15d1691e6 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "cinder-quobyte-40761f37-48b5-44ca-b3c9-cd32dfffc644" acquired by "delete_volume" :: waited 0.014s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:33:37 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e2b62c-da47-4c4d-b2d0-278364eed496]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:33:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-35774d44-1fbb-48d3-8584-61f15d1691e6 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-40761f37-48b5-44ca-b3c9-cd32dfffc644 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:37 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-40761f37-48b5-44ca-b3c9-cd32dfffc644 Sep 01 08:33:37 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:37 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-35774d44-1fbb-48d3-8584-61f15d1691e6 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-40761f37-48b5-44ca-b3c9-cd32dfffc644" returned: 0 in 0.346s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-35774d44-1fbb-48d3-8584-61f15d1691e6 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-40761f37-48b5-44ca-b3c9-cd32dfffc644 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:37 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-40761f37-48b5-44ca-b3c9-cd32dfffc644 Sep 01 08:33:37 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:37 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-35774d44-1fbb-48d3-8584-61f15d1691e6 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-40761f37-48b5-44ca-b3c9-cd32dfffc644" returned: 0 in 0.240s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-35774d44-1fbb-48d3-8584-61f15d1691e6 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "cinder-quobyte-40761f37-48b5-44ca-b3c9-cd32dfffc644" released by "delete_volume" :: held 0.622s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:33:37 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-35774d44-1fbb-48d3-8584-61f15d1691e6 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Created reservations ['21554499-f08b-405a-96e3-3806ec241834', '974afa7c-6dd2-4e2e-92de-791dfd54b758', '033273fb-f6ad-48f1-a63c-48185ac80cfe', 'b630a7ff-74c2-4f03-9d1b-ca6307b8780a'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:33:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-35774d44-1fbb-48d3-8584-61f15d1691e6 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:33:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-35774d44-1fbb-48d3-8584-61f15d1691e6 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:33:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-35774d44-1fbb-48d3-8584-61f15d1691e6 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:33:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-35774d44-1fbb-48d3-8584-61f15d1691e6 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:33:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-35774d44-1fbb-48d3-8584-61f15d1691e6 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:33:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-35774d44-1fbb-48d3-8584-61f15d1691e6 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:37 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:33:37 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:38 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-35774d44-1fbb-48d3-8584-61f15d1691e6 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.244s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:38 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-35774d44-1fbb-48d3-8584-61f15d1691e6 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:33:38 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-35774d44-1fbb-48d3-8584-61f15d1691e6 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Deleted volume successfully. Sep 01 08:33:38 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-35774d44-1fbb-48d3-8584-61f15d1691e6 tempest-CreateVolumesFromSourceVolumeTest-582539604 None] Lock "cinder-40761f37-48b5-44ca-b3c9-cd32dfffc644-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:33:42 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:33:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Flow 'volume_create_manager' (9146f01f-56bd-4091-af87-60b8d9d7f600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:33:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a132b81-6a5d-4c73-bdf2-dc2b8723bb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a132b81-6a5d-4c73-bdf2-dc2b8723bb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a995bc2-4942-42b2-a293-8c74617af8e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6c3fc4ada81468a80a1f03f838519e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:33:43Z,use_quota=True,user_id='a75edaa921fc455494afc06cee131f6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d849ca7-3b6e-4f43-b882-c132638d77b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d849ca7-3b6e-4f43-b882-c132638d77b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c157cb3-889c-4c49-934c-7e69f44668eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:42 devstack cinder-volume[86893]: DEBUG cinder.image.glance [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Creating Keystone auth plugin from conf {{(pid=86893) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 08:33:43 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c157cb3-889c-4c49-934c-7e69f44668eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8a995bc2-4942-42b2-a293-8c74617af8e5', 'volume_name': 'volume-8a995bc2-4942-42b2-a293-8c74617af8e5', 'volume_size': 1, 'image_id': '7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd7c8980d8b8e9c35422f29120cb2329c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f6c3fc4ada81468a80a1f03f838519e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '686059bd1c9416780d2cd77076cee3b4b74fa35de5abc28f07285d2a216399048be02c6569053856be37d25d6c138fccd812ba7cdacec0263e2fe8c501cf7bc7', 'id': '7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2', 'created_at': datetime.datetime(2026, 9, 1, 6, 33, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 6, 33, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2/file', 'properties': {}}, 'image_service': }' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:43 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c468c5da-520d-41a7-b94d-4c105f8eb7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:43 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c468c5da-520d-41a7-b94d-4c105f8eb7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:43 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e28d49-7add-4112-8e33-3806f34db75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:43 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Volume 8a995bc2-4942-42b2-a293-8c74617af8e5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8a995bc2-4942-42b2-a293-8c74617af8e5', 'volume_size': 1, 'image_id': '7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd7c8980d8b8e9c35422f29120cb2329c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f6c3fc4ada81468a80a1f03f838519e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '686059bd1c9416780d2cd77076cee3b4b74fa35de5abc28f07285d2a216399048be02c6569053856be37d25d6c138fccd812ba7cdacec0263e2fe8c501cf7bc7', 'id': '7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2', 'created_at': datetime.datetime(2026, 9, 1, 6, 33, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 6, 33, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2/file', 'properties': {}}, 'image_service': } Sep 01 08:33:43 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Trying to clone 8a995bc2-4942-42b2-a293-8c74617af8e5 from image 7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2', 'metadata': {}}]). {{(pid=86893) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1100}} Sep 01 08:33:43 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_fe6n_mssdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86893) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 08:33:43 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Image download 0.00 MB at 0.00 MB/s Sep 01 08:33:43 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ccb2f0-af5f-4d12-819b-c325df1eb03f]: (4, 'raw') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:33:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_fe6n_mssdevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:43 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_fe6n_mssdevstack@QuobyteHD Sep 01 08:33:43 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:43 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_fe6n_mssdevstack@QuobyteHD" returned: 0 in 0.322s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_fe6n_mssdevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:43 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_fe6n_mssdevstack@QuobyteHD Sep 01 08:33:43 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:43 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_fe6n_mssdevstack@QuobyteHD" returned: 1 in 0.314s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_fe6n_mssdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 08:33:43 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Temporary image 7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2 is fetched for user a75edaa921fc455494afc06cee131f6d. {{(pid=86893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 08:33:43 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ed11e7-4832-4814-8c80-a672ee88036a]: (4, 'raw') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:33:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_fe6n_mssdevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:44 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_fe6n_mssdevstack@QuobyteHD Sep 01 08:33:44 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:44 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_fe6n_mssdevstack@QuobyteHD" returned: 0 in 0.326s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_fe6n_mssdevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:44 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_fe6n_mssdevstack@QuobyteHD Sep 01 08:33:44 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:44 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_fe6n_mssdevstack@QuobyteHD" returned: 1 in 0.325s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_fe6n_mssdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 08:33:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:33:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:33:44 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a995bc2-4942-42b2-a293-8c74617af8e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6c3fc4ada81468a80a1f03f838519e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:33:43Z,use_quota=True,user_id='a75edaa921fc455494afc06cee131f6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:33:44 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Creating volume 8a995bc2-4942-42b2-a293-8c74617af8e5 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:33:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:33:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:33:44 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:33:44 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:33:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:33:44 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:33:44 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:33:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8a995bc2-4942-42b2-a293-8c74617af8e5 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:44 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8a995bc2-4942-42b2-a293-8c74617af8e5 1073741824 Sep 01 08:33:44 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:44 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8a995bc2-4942-42b2-a293-8c74617af8e5 1073741824" returned: 0 in 0.408s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8a995bc2-4942-42b2-a293-8c74617af8e5 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:45 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8a995bc2-4942-42b2-a293-8c74617af8e5 Sep 01 08:33:45 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:45 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8a995bc2-4942-42b2-a293-8c74617af8e5" returned: 0 in 0.240s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:45 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:33:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:33:45 devstack cinder-volume[86893]: DEBUG cinder.volume.volume_utils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Attempting download of 7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2 ((None, [{'url': 'file:///opt/stack/data/glance/images/7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2', 'metadata': {}}])) to volume 8a995bc2-4942-42b2-a293-8c74617af8e5. {{(pid=86893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 08:33:45 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66f0f51-9f09-4629-a62c-ca407f5924b8]: (4, 'raw') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:33:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_dj4pwg0n {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:45 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_dj4pwg0n Sep 01 08:33:45 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:45 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_dj4pwg0n" returned: 0 in 0.326s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_dj4pwg0n {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:45 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_dj4pwg0n Sep 01 08:33:45 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:45 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_dj4pwg0n" returned: 1 in 0.336s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_dj4pwg0n' failed. Not Retrying. {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 08:33:45 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf93ec4-7b21-438b-a0e9-309152965153]: (4, 'raw') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:33:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_fe6n_mssdevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:46 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_fe6n_mssdevstack@QuobyteHD Sep 01 08:33:46 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:46 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_fe6n_mssdevstack@QuobyteHD" returned: 0 in 0.322s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_fe6n_mssdevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:46 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_fe6n_mssdevstack@QuobyteHD Sep 01 08:33:46 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:46 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_fe6n_mssdevstack@QuobyteHD" returned: 1 in 0.312s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_fe6n_mssdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 08:33:46 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] 7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2 was raw, converting to qcow2 {{(pid=86893) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 08:33:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_fe6n_mssdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8a995bc2-4942-42b2-a293-8c74617af8e5 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:46 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_fe6n_mssdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8a995bc2-4942-42b2-a293-8c74617af8e5 Sep 01 08:33:46 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:47 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_fe6n_mssdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8a995bc2-4942-42b2-a293-8c74617af8e5" returned: 0 in 0.398s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:47 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2_fe6n_mssdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8a995bc2-4942-42b2-a293-8c74617af8e5 {{(pid=86893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 08:33:47 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 08:33:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8a995bc2-4942-42b2-a293-8c74617af8e5 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:47 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8a995bc2-4942-42b2-a293-8c74617af8e5 1G Sep 01 08:33:47 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:47 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8a995bc2-4942-42b2-a293-8c74617af8e5 1G" returned: 0 in 0.300s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:47 devstack cinder-volume[86893]: DEBUG cinder.volume.volume_utils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Downloaded image 7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2 ((None, [{'url': 'file:///opt/stack/data/glance/images/7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2', 'metadata': {}}])) to volume 8a995bc2-4942-42b2-a293-8c74617af8e5 successfully. {{(pid=86893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 08:33:47 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Temporary image 7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2 for user a75edaa921fc455494afc06cee131f6d is deleted. {{(pid=86893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 08:33:47 devstack cinder-volume[86893]: DEBUG cinder.volume.volume_utils [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Marking volume 8a995bc2-4942-42b2-a293-8c74617af8e5 as bootable. {{(pid=86893) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 08:33:47 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Copying metadata from image 7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2 to 8a995bc2-4942-42b2-a293-8c74617af8e5. {{(pid=86893) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 08:33:47 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Creating volume glance metadata for volume 8a995bc2-4942-42b2-a293-8c74617af8e5 backed by image 7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2 with: {'image_id': '7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd7c8980d8b8e9c35422f29120cb2329c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86893) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 08:33:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e28d49-7add-4112-8e33-3806f34db75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a995bc2-4942-42b2-a293-8c74617af8e5', 'volume_size': 1, 'image_id': '7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd7c8980d8b8e9c35422f29120cb2329c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f6c3fc4ada81468a80a1f03f838519e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '686059bd1c9416780d2cd77076cee3b4b74fa35de5abc28f07285d2a216399048be02c6569053856be37d25d6c138fccd812ba7cdacec0263e2fe8c501cf7bc7', 'id': '7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2', 'created_at': datetime.datetime(2026, 9, 1, 6, 33, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 6, 33, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7e4a9dc5-39c0-4ffe-85fa-3cde79806bd2/file', 'properties': {}}, 'image_service': }' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1935b41b-f44e-48f4-afb2-8de3d35a2db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:47 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Volume volume-8a995bc2-4942-42b2-a293-8c74617af8e5 (8a995bc2-4942-42b2-a293-8c74617af8e5): created successfully Sep 01 08:33:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1935b41b-f44e-48f4-afb2-8de3d35a2db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Flow 'volume_create_manager' (9146f01f-56bd-4091-af87-60b8d9d7f600) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:33:47 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-5d3f8bb3-6be0-45ba-94ea-9a3ac3f97bcc tempest-VolumeImageDependencyTests-2120740701 None] Created volume successfully. Sep 01 08:33:48 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1b3b43fe-282a-4552-b3af-02a6e64e0d2d tempest-VolumeImageDependencyTests-2120740701 None] Acquiring lock "cinder-8a995bc2-4942-42b2-a293-8c74617af8e5-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:33:48 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1b3b43fe-282a-4552-b3af-02a6e64e0d2d tempest-VolumeImageDependencyTests-2120740701 None] Lock "cinder-8a995bc2-4942-42b2-a293-8c74617af8e5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:33:48 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1b3b43fe-282a-4552-b3af-02a6e64e0d2d tempest-VolumeImageDependencyTests-2120740701 None] Acquiring lock "cinder-quobyte-8a995bc2-4942-42b2-a293-8c74617af8e5" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:33:48 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1b3b43fe-282a-4552-b3af-02a6e64e0d2d tempest-VolumeImageDependencyTests-2120740701 None] Lock "cinder-quobyte-8a995bc2-4942-42b2-a293-8c74617af8e5" acquired by "delete_volume" :: waited 0.017s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:33:48 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cb57a0-e45b-4212-8224-e982513214a3]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:33:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1b3b43fe-282a-4552-b3af-02a6e64e0d2d tempest-VolumeImageDependencyTests-2120740701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8a995bc2-4942-42b2-a293-8c74617af8e5 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:48 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8a995bc2-4942-42b2-a293-8c74617af8e5 Sep 01 08:33:48 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:48 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1b3b43fe-282a-4552-b3af-02a6e64e0d2d tempest-VolumeImageDependencyTests-2120740701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8a995bc2-4942-42b2-a293-8c74617af8e5" returned: 0 in 0.350s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1b3b43fe-282a-4552-b3af-02a6e64e0d2d tempest-VolumeImageDependencyTests-2120740701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8a995bc2-4942-42b2-a293-8c74617af8e5 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:48 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8a995bc2-4942-42b2-a293-8c74617af8e5 Sep 01 08:33:48 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:49 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1b3b43fe-282a-4552-b3af-02a6e64e0d2d tempest-VolumeImageDependencyTests-2120740701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-8a995bc2-4942-42b2-a293-8c74617af8e5" returned: 0 in 0.245s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:49 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1b3b43fe-282a-4552-b3af-02a6e64e0d2d tempest-VolumeImageDependencyTests-2120740701 None] Lock "cinder-quobyte-8a995bc2-4942-42b2-a293-8c74617af8e5" released by "delete_volume" :: held 0.636s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:33:49 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-1b3b43fe-282a-4552-b3af-02a6e64e0d2d tempest-VolumeImageDependencyTests-2120740701 None] Created reservations ['d70b909c-bbb8-4807-bf70-8d75bdfe3073', 'ffe70186-7ffd-46e9-b0b7-18bc553ec418', 'b092c12b-22b2-44df-bf7c-97dfde6b2d88', '37f8c41e-f1fa-4282-855d-a996f598a9c8'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:33:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1b3b43fe-282a-4552-b3af-02a6e64e0d2d tempest-VolumeImageDependencyTests-2120740701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:33:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1b3b43fe-282a-4552-b3af-02a6e64e0d2d tempest-VolumeImageDependencyTests-2120740701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:33:49 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1b3b43fe-282a-4552-b3af-02a6e64e0d2d tempest-VolumeImageDependencyTests-2120740701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:33:49 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1b3b43fe-282a-4552-b3af-02a6e64e0d2d tempest-VolumeImageDependencyTests-2120740701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:33:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1b3b43fe-282a-4552-b3af-02a6e64e0d2d tempest-VolumeImageDependencyTests-2120740701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:33:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1b3b43fe-282a-4552-b3af-02a6e64e0d2d tempest-VolumeImageDependencyTests-2120740701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:49 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:33:49 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:49 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1b3b43fe-282a-4552-b3af-02a6e64e0d2d tempest-VolumeImageDependencyTests-2120740701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.250s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:49 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-1b3b43fe-282a-4552-b3af-02a6e64e0d2d tempest-VolumeImageDependencyTests-2120740701 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:33:49 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-1b3b43fe-282a-4552-b3af-02a6e64e0d2d tempest-VolumeImageDependencyTests-2120740701 None] Deleted volume successfully. Sep 01 08:33:49 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1b3b43fe-282a-4552-b3af-02a6e64e0d2d tempest-VolumeImageDependencyTests-2120740701 None] Lock "cinder-8a995bc2-4942-42b2-a293-8c74617af8e5-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:33:52 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:33:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] Flow 'volume_create_manager' (08a0982a-9e04-49db-9c8b-66d851317b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:33:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2cbcfc-13d8-4583-9110-5962274ce25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2cbcfc-13d8-4583-9110-5962274ce25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-758994260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f52014e1-ef74-4d5c-b87d-b0d7cda7d3f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7719b21099a54b18a859efdcf08bc54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:33:53Z,use_quota=True,user_id='9706592b8f4f4f9b92d27d39c6767a9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9736ab6c-ce55-4aa1-b37a-f4d29506f1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9736ab6c-ce55-4aa1-b37a-f4d29506f1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd3d319-e7fb-4284-889c-bed002bbd6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd3d319-e7fb-4284-889c-bed002bbd6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f52014e1-ef74-4d5c-b87d-b0d7cda7d3f7', 'volume_name': 'volume-f52014e1-ef74-4d5c-b87d-b0d7cda7d3f7', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a48d04b-5291-4a43-9180-b36ee7875f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a48d04b-5291-4a43-9180-b36ee7875f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc58b084-378f-489f-8df4-3cd327c24ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:52 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] Volume f52014e1-ef74-4d5c-b87d-b0d7cda7d3f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f52014e1-ef74-4d5c-b87d-b0d7cda7d3f7', 'volume_size': 1} Sep 01 08:33:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:33:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:33:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-758994260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f52014e1-ef74-4d5c-b87d-b0d7cda7d3f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7719b21099a54b18a859efdcf08bc54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:33:53Z,use_quota=True,user_id='9706592b8f4f4f9b92d27d39c6767a9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:33:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] Creating volume f52014e1-ef74-4d5c-b87d-b0d7cda7d3f7 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:33:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:33:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:33:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:33:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:33:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:33:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:33:52 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:33:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f52014e1-ef74-4d5c-b87d-b0d7cda7d3f7 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:53 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f52014e1-ef74-4d5c-b87d-b0d7cda7d3f7 1073741824 Sep 01 08:33:53 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:53 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f52014e1-ef74-4d5c-b87d-b0d7cda7d3f7 1073741824" returned: 0 in 0.397s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f52014e1-ef74-4d5c-b87d-b0d7cda7d3f7 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:53 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f52014e1-ef74-4d5c-b87d-b0d7cda7d3f7 Sep 01 08:33:53 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:53 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f52014e1-ef74-4d5c-b87d-b0d7cda7d3f7" returned: 0 in 0.243s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:53 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:33:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:33:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc58b084-378f-489f-8df4-3cd327c24ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f52014e1-ef74-4d5c-b87d-b0d7cda7d3f7', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c8e6b8-4b66-499d-8284-9ba1dee8e5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:53 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] Volume volume-f52014e1-ef74-4d5c-b87d-b0d7cda7d3f7 (f52014e1-ef74-4d5c-b87d-b0d7cda7d3f7): created successfully Sep 01 08:33:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c8e6b8-4b66-499d-8284-9ba1dee8e5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] Flow 'volume_create_manager' (08a0982a-9e04-49db-9c8b-66d851317b6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:33:53 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-d47cdd7e-8c6c-4ab5-859d-24ab6409f196 tempest-ProjectReaderTests-1302876778 None] Created volume successfully. Sep 01 08:33:54 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-118cf77a-4b50-4b68-a95b-776c21c6a5b2 tempest-ProjectReaderTests-1302876778 None] Acquiring lock "cinder-f52014e1-ef74-4d5c-b87d-b0d7cda7d3f7-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:33:54 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-118cf77a-4b50-4b68-a95b-776c21c6a5b2 tempest-ProjectReaderTests-1302876778 None] Lock "cinder-f52014e1-ef74-4d5c-b87d-b0d7cda7d3f7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:33:54 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-118cf77a-4b50-4b68-a95b-776c21c6a5b2 tempest-ProjectReaderTests-1302876778 None] Acquiring lock "cinder-quobyte-f52014e1-ef74-4d5c-b87d-b0d7cda7d3f7" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:33:54 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-118cf77a-4b50-4b68-a95b-776c21c6a5b2 tempest-ProjectReaderTests-1302876778 None] Lock "cinder-quobyte-f52014e1-ef74-4d5c-b87d-b0d7cda7d3f7" acquired by "delete_volume" :: waited 0.014s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:33:54 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfe1265-7200-478a-9515-41784b988ae8]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:33:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-118cf77a-4b50-4b68-a95b-776c21c6a5b2 tempest-ProjectReaderTests-1302876778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f52014e1-ef74-4d5c-b87d-b0d7cda7d3f7 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:54 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f52014e1-ef74-4d5c-b87d-b0d7cda7d3f7 Sep 01 08:33:54 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:54 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-118cf77a-4b50-4b68-a95b-776c21c6a5b2 tempest-ProjectReaderTests-1302876778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f52014e1-ef74-4d5c-b87d-b0d7cda7d3f7" returned: 0 in 0.348s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-118cf77a-4b50-4b68-a95b-776c21c6a5b2 tempest-ProjectReaderTests-1302876778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f52014e1-ef74-4d5c-b87d-b0d7cda7d3f7 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:54 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f52014e1-ef74-4d5c-b87d-b0d7cda7d3f7 Sep 01 08:33:54 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:54 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-118cf77a-4b50-4b68-a95b-776c21c6a5b2 tempest-ProjectReaderTests-1302876778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f52014e1-ef74-4d5c-b87d-b0d7cda7d3f7" returned: 0 in 0.239s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:54 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-118cf77a-4b50-4b68-a95b-776c21c6a5b2 tempest-ProjectReaderTests-1302876778 None] Lock "cinder-quobyte-f52014e1-ef74-4d5c-b87d-b0d7cda7d3f7" released by "delete_volume" :: held 0.622s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:33:54 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-118cf77a-4b50-4b68-a95b-776c21c6a5b2 tempest-ProjectReaderTests-1302876778 None] Created reservations ['080decb8-a4c1-4a2e-aa8b-6ed347fe304a', 'b4f968bd-fd70-46d1-a370-e38be4dd7e1d', '33ba1df4-e930-4ade-afa1-2fba9de3fd84', '30c4af0b-0cbc-4510-9d68-0945e18444ba'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:33:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-118cf77a-4b50-4b68-a95b-776c21c6a5b2 tempest-ProjectReaderTests-1302876778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:33:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-118cf77a-4b50-4b68-a95b-776c21c6a5b2 tempest-ProjectReaderTests-1302876778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:33:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-118cf77a-4b50-4b68-a95b-776c21c6a5b2 tempest-ProjectReaderTests-1302876778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:33:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-118cf77a-4b50-4b68-a95b-776c21c6a5b2 tempest-ProjectReaderTests-1302876778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:33:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-118cf77a-4b50-4b68-a95b-776c21c6a5b2 tempest-ProjectReaderTests-1302876778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:33:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-118cf77a-4b50-4b68-a95b-776c21c6a5b2 tempest-ProjectReaderTests-1302876778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:54 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:33:54 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:55 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-118cf77a-4b50-4b68-a95b-776c21c6a5b2 tempest-ProjectReaderTests-1302876778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.243s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:55 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-118cf77a-4b50-4b68-a95b-776c21c6a5b2 tempest-ProjectReaderTests-1302876778 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:33:55 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-118cf77a-4b50-4b68-a95b-776c21c6a5b2 tempest-ProjectReaderTests-1302876778 None] Deleted volume successfully. Sep 01 08:33:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-118cf77a-4b50-4b68-a95b-776c21c6a5b2 tempest-ProjectReaderTests-1302876778 None] Lock "cinder-f52014e1-ef74-4d5c-b87d-b0d7cda7d3f7-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:33:55 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:33:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] Flow 'volume_create_manager' (9ad73e6e-23ff-4ca1-b9f6-7d256d8f6c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:33:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db24d4e9-fcba-4b66-9c22-d3c76298e574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db24d4e9-fcba-4b66-9c22-d3c76298e574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1468453922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd0e0e86-0a5e-4376-bd22-e67b047c3b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7719b21099a54b18a859efdcf08bc54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:33:56Z,use_quota=True,user_id='9706592b8f4f4f9b92d27d39c6767a9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76424ec1-59a0-449a-a433-72c5631d04f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76424ec1-59a0-449a-a433-72c5631d04f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd4ae30f-9b36-4c15-9b79-7155bce11c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd4ae30f-9b36-4c15-9b79-7155bce11c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd0e0e86-0a5e-4376-bd22-e67b047c3b5c', 'volume_name': 'volume-cd0e0e86-0a5e-4376-bd22-e67b047c3b5c', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67d925c-e1ec-47a0-a737-2d75698d288f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67d925c-e1ec-47a0-a737-2d75698d288f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45dbc62-c3c4-4c7d-98dc-b9b1f4040a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:55 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] Volume cd0e0e86-0a5e-4376-bd22-e67b047c3b5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd0e0e86-0a5e-4376-bd22-e67b047c3b5c', 'volume_size': 1} Sep 01 08:33:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:33:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:33:55 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1468453922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd0e0e86-0a5e-4376-bd22-e67b047c3b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7719b21099a54b18a859efdcf08bc54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:33:56Z,use_quota=True,user_id='9706592b8f4f4f9b92d27d39c6767a9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:33:55 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] Creating volume cd0e0e86-0a5e-4376-bd22-e67b047c3b5c {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:33:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:33:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:33:55 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:33:55 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:33:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:33:55 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:33:55 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:33:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd0e0e86-0a5e-4376-bd22-e67b047c3b5c 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:55 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd0e0e86-0a5e-4376-bd22-e67b047c3b5c 1073741824 Sep 01 08:33:55 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:56 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd0e0e86-0a5e-4376-bd22-e67b047c3b5c 1073741824" returned: 0 in 0.394s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd0e0e86-0a5e-4376-bd22-e67b047c3b5c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:56 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd0e0e86-0a5e-4376-bd22-e67b047c3b5c Sep 01 08:33:56 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:56 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd0e0e86-0a5e-4376-bd22-e67b047c3b5c" returned: 0 in 0.237s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:56 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:33:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:33:56 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45dbc62-c3c4-4c7d-98dc-b9b1f4040a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd0e0e86-0a5e-4376-bd22-e67b047c3b5c', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:56 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd2d844-5a7a-4006-961b-156df9e43a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:33:56 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] Volume volume-cd0e0e86-0a5e-4376-bd22-e67b047c3b5c (cd0e0e86-0a5e-4376-bd22-e67b047c3b5c): created successfully Sep 01 08:33:56 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd2d844-5a7a-4006-961b-156df9e43a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:33:56 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] Flow 'volume_create_manager' (9ad73e6e-23ff-4ca1-b9f6-7d256d8f6c1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:33:56 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-076d7232-4b71-4388-9a6e-c9fcb0e7adc0 tempest-ProjectReaderTests-1302876778 None] Created volume successfully. Sep 01 08:33:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-18c7be0a-6f89-41ef-b670-58cb29b10aa6 tempest-ProjectReaderTests-1302876778 None] Acquiring lock "cinder-cd0e0e86-0a5e-4376-bd22-e67b047c3b5c-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:33:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-18c7be0a-6f89-41ef-b670-58cb29b10aa6 tempest-ProjectReaderTests-1302876778 None] Lock "cinder-cd0e0e86-0a5e-4376-bd22-e67b047c3b5c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:33:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-18c7be0a-6f89-41ef-b670-58cb29b10aa6 tempest-ProjectReaderTests-1302876778 None] Acquiring lock "cinder-quobyte-cd0e0e86-0a5e-4376-bd22-e67b047c3b5c" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:33:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-18c7be0a-6f89-41ef-b670-58cb29b10aa6 tempest-ProjectReaderTests-1302876778 None] Lock "cinder-quobyte-cd0e0e86-0a5e-4376-bd22-e67b047c3b5c" acquired by "delete_volume" :: waited 0.015s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:33:56 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d91748-01f5-4ffb-af54-6c2b96f6d327]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:33:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-18c7be0a-6f89-41ef-b670-58cb29b10aa6 tempest-ProjectReaderTests-1302876778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd0e0e86-0a5e-4376-bd22-e67b047c3b5c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:56 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd0e0e86-0a5e-4376-bd22-e67b047c3b5c Sep 01 08:33:56 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:57 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-18c7be0a-6f89-41ef-b670-58cb29b10aa6 tempest-ProjectReaderTests-1302876778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd0e0e86-0a5e-4376-bd22-e67b047c3b5c" returned: 0 in 0.350s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-18c7be0a-6f89-41ef-b670-58cb29b10aa6 tempest-ProjectReaderTests-1302876778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd0e0e86-0a5e-4376-bd22-e67b047c3b5c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:57 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd0e0e86-0a5e-4376-bd22-e67b047c3b5c Sep 01 08:33:57 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:57 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-18c7be0a-6f89-41ef-b670-58cb29b10aa6 tempest-ProjectReaderTests-1302876778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cd0e0e86-0a5e-4376-bd22-e67b047c3b5c" returned: 0 in 0.241s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-18c7be0a-6f89-41ef-b670-58cb29b10aa6 tempest-ProjectReaderTests-1302876778 None] Lock "cinder-quobyte-cd0e0e86-0a5e-4376-bd22-e67b047c3b5c" released by "delete_volume" :: held 0.626s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:33:57 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-18c7be0a-6f89-41ef-b670-58cb29b10aa6 tempest-ProjectReaderTests-1302876778 None] Created reservations ['09f0d1bc-f9c9-4705-995e-132ea41549b9', '0ce00c87-0501-4dc5-bea2-797ffa7c33a4', '702fe0ab-14b3-41b7-aebd-90ef693bff8b', 'dacf0f17-25c3-47e8-8154-22b393e29fd1'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:33:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-18c7be0a-6f89-41ef-b670-58cb29b10aa6 tempest-ProjectReaderTests-1302876778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:33:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-18c7be0a-6f89-41ef-b670-58cb29b10aa6 tempest-ProjectReaderTests-1302876778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:33:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-18c7be0a-6f89-41ef-b670-58cb29b10aa6 tempest-ProjectReaderTests-1302876778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:33:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-18c7be0a-6f89-41ef-b670-58cb29b10aa6 tempest-ProjectReaderTests-1302876778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:33:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-18c7be0a-6f89-41ef-b670-58cb29b10aa6 tempest-ProjectReaderTests-1302876778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:33:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-18c7be0a-6f89-41ef-b670-58cb29b10aa6 tempest-ProjectReaderTests-1302876778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:33:57 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:33:57 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:33:57 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Sep 01 08:33:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-18c7be0a-6f89-41ef-b670-58cb29b10aa6 tempest-ProjectReaderTests-1302876778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.246s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:33:57 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-18c7be0a-6f89-41ef-b670-58cb29b10aa6 tempest-ProjectReaderTests-1302876778 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:33:57 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-18c7be0a-6f89-41ef-b670-58cb29b10aa6 tempest-ProjectReaderTests-1302876778 None] Deleted volume successfully. Sep 01 08:33:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-18c7be0a-6f89-41ef-b670-58cb29b10aa6 tempest-ProjectReaderTests-1302876778 None] Lock "cinder-cd0e0e86-0a5e-4376-bd22-e67b047c3b5c-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:07 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:UPDATE=112,cinder:SELECT=58,cinder:DELETE=9,cinder:INSERT=25 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:34:07 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=79,cinder:INSERT=29,cinder:UPDATE=89,cinder:DELETE=9 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:34:09 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:34:09 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] Flow 'volume_create_manager' (2861e411-8e4b-409b-abf4-f3eea954c5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:09 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09239810-89b2-46cb-8e69-91993e3bf5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:09 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09239810-89b2-46cb-8e69-91993e3bf5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-616401278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7618a1b9-6cb3-4ec3-9358-b779bda14e84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaa2631f8ae54a6cbf52988a6a344596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:10Z,use_quota=True,user_id='5af838463bb8498bbf4ae4278b83af2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:09 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ef2001-ae18-4ef6-b071-22724381b887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:09 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ef2001-ae18-4ef6-b071-22724381b887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:09 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a53f5e9a-2749-4026-9e63-3996d16765a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:09 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a53f5e9a-2749-4026-9e63-3996d16765a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7618a1b9-6cb3-4ec3-9358-b779bda14e84', 'volume_name': 'volume-7618a1b9-6cb3-4ec3-9358-b779bda14e84', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:09 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e0f7da-f826-4f6c-8080-dc689ebea0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:09 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e0f7da-f826-4f6c-8080-dc689ebea0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:09 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae16b0e4-6d7c-48ae-aa72-103942853614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:09 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] Volume 7618a1b9-6cb3-4ec3-9358-b779bda14e84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7618a1b9-6cb3-4ec3-9358-b779bda14e84', 'volume_size': 1} Sep 01 08:34:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:09 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-616401278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7618a1b9-6cb3-4ec3-9358-b779bda14e84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaa2631f8ae54a6cbf52988a6a344596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:10Z,use_quota=True,user_id='5af838463bb8498bbf4ae4278b83af2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:34:09 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] Creating volume 7618a1b9-6cb3-4ec3-9358-b779bda14e84 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:34:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:09 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:10 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:10 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:34:10 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:34:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7618a1b9-6cb3-4ec3-9358-b779bda14e84 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:10 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7618a1b9-6cb3-4ec3-9358-b779bda14e84 1073741824 Sep 01 08:34:10 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:10 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:34:10 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Flow 'volume_create_manager' (a06d5d51-e100-4626-bf49-1699cd4f3674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:10 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b54461c-14e7-411e-9e17-14b6222fb701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:10 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b54461c-14e7-411e-9e17-14b6222fb701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1969375387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8a0423b-e940-4d04-a43c-dd3cec290f15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9acd52b8e17a4c54b5ae533ef4a60d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:10Z,use_quota=True,user_id='9800cc386580413fa5de08b5392d4078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:10 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24bba7dc-a78a-4c00-9d2a-24c05008672e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:10 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24bba7dc-a78a-4c00-9d2a-24c05008672e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:10 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d3e8ec-fa70-45fa-85f0-2606b5cde0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:10 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d3e8ec-fa70-45fa-85f0-2606b5cde0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8a0423b-e940-4d04-a43c-dd3cec290f15', 'volume_name': 'volume-f8a0423b-e940-4d04-a43c-dd3cec290f15', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:10 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (613a02c0-4abb-4e6e-986b-952fe3638319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:10 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (613a02c0-4abb-4e6e-986b-952fe3638319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:10 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a25daa8-da3f-4687-9490-eff394d21ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:10 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Volume f8a0423b-e940-4d04-a43c-dd3cec290f15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8a0423b-e940-4d04-a43c-dd3cec290f15', 'volume_size': 1} Sep 01 08:34:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:10 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:34:10 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] Flow 'volume_create_manager' (346b0cef-77b1-4d35-b611-1bf949a83d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:10 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c7b230-34bc-44a0-983a-c97849c7f53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:10 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2259d33e-21aa-42c5-92f4-49b14d088880 tempest-ProjectAdminTests-1449475715 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.0671081542969, 'free_capacity_gb': 1774.0671081542969, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86893) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 08:34:10 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c7b230-34bc-44a0-983a-c97849c7f53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2060740571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e75d0fc9-c3f9-4c1a-8e29-f8365e38b85f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaa2631f8ae54a6cbf52988a6a344596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:10Z,use_quota=True,user_id='5af838463bb8498bbf4ae4278b83af2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:10 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25544c5e-fb74-422c-9ca1-e23911b81a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:10 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25544c5e-fb74-422c-9ca1-e23911b81a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:10 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (728ab295-2568-48e1-8426-c9b686f74ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:10 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (728ab295-2568-48e1-8426-c9b686f74ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e75d0fc9-c3f9-4c1a-8e29-f8365e38b85f', 'volume_name': 'volume-e75d0fc9-c3f9-4c1a-8e29-f8365e38b85f', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:10 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de91ba11-26f6-48fe-846a-93069511676d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:10 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de91ba11-26f6-48fe-846a-93069511676d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:10 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e658bf8d-bf88-45a4-8e63-8b6220f4ee49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:10 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] Volume e75d0fc9-c3f9-4c1a-8e29-f8365e38b85f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e75d0fc9-c3f9-4c1a-8e29-f8365e38b85f', 'volume_size': 1} Sep 01 08:34:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:10 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7618a1b9-6cb3-4ec3-9358-b779bda14e84 1073741824" returned: 0 in 0.695s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7618a1b9-6cb3-4ec3-9358-b779bda14e84 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:10 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7618a1b9-6cb3-4ec3-9358-b779bda14e84 Sep 01 08:34:10 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:11 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7618a1b9-6cb3-4ec3-9358-b779bda14e84" returned: 0 in 0.328s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.855s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1969375387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8a0423b-e940-4d04-a43c-dd3cec290f15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9acd52b8e17a4c54b5ae533ef4a60d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:10Z,use_quota=True,user_id='9800cc386580413fa5de08b5392d4078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Creating volume f8a0423b-e940-4d04-a43c-dd3cec290f15 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:34:11 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f8a0423b-e940-4d04-a43c-dd3cec290f15 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:11 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f8a0423b-e940-4d04-a43c-dd3cec290f15 1073741824 Sep 01 08:34:11 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae16b0e4-6d7c-48ae-aa72-103942853614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7618a1b9-6cb3-4ec3-9358-b779bda14e84', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (301603cc-16d6-44a1-b5df-783043d332ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:11 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] Volume volume-7618a1b9-6cb3-4ec3-9358-b779bda14e84 (7618a1b9-6cb3-4ec3-9358-b779bda14e84): created successfully Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (301603cc-16d6-44a1-b5df-783043d332ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] Flow 'volume_create_manager' (2861e411-8e4b-409b-abf4-f3eea954c5e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] Flow 'volume_create_manager' (aab39d83-ff95-44dc-a14f-fccd861855a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97a38a8-b501-4ba3-83ae-df37214963d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:11 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-c5cb4b9e-38f4-4163-8af0-86fff5694941 tempest-CreateVolumesFromImageTest-443328476 None] Created volume successfully. Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97a38a8-b501-4ba3-83ae-df37214963d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1163581757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f1de825-9519-4d1f-82b6-6dfd5946114e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaa2631f8ae54a6cbf52988a6a344596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:11Z,use_quota=True,user_id='5af838463bb8498bbf4ae4278b83af2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c36adda4-fc6a-40d6-a81e-26dc874d487c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c36adda4-fc6a-40d6-a81e-26dc874d487c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd451c05-580b-4e8d-8008-bc29b51d0f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd451c05-580b-4e8d-8008-bc29b51d0f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f1de825-9519-4d1f-82b6-6dfd5946114e', 'volume_name': 'volume-9f1de825-9519-4d1f-82b6-6dfd5946114e', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48b7b9d0-a4d7-463e-8762-d2facd59e39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48b7b9d0-a4d7-463e-8762-d2facd59e39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b24e44e-101b-472b-8b25-2c6f66eab58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:11 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] Volume 9f1de825-9519-4d1f-82b6-6dfd5946114e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f1de825-9519-4d1f-82b6-6dfd5946114e', 'volume_size': 1} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] Flow 'volume_create_manager' (1a2a1afb-a438-49ff-8a03-ce9139330402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e560ff-9462-4118-b79d-c42e7273d06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e560ff-9462-4118-b79d-c42e7273d06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-210818487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25c28c07-94b1-43f8-ac35-d029ed9337b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaa2631f8ae54a6cbf52988a6a344596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:12Z,use_quota=True,user_id='5af838463bb8498bbf4ae4278b83af2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af2eafbf-81ca-46d0-b500-e168f93e40e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af2eafbf-81ca-46d0-b500-e168f93e40e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bfee697-4762-46ff-a0ae-2f371a3106ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bfee697-4762-46ff-a0ae-2f371a3106ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25c28c07-94b1-43f8-ac35-d029ed9337b0', 'volume_name': 'volume-25c28c07-94b1-43f8-ac35-d029ed9337b0', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb4764f3-4c53-4a01-b03d-83775f316f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb4764f3-4c53-4a01-b03d-83775f316f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c18730a2-8e7b-4a3a-b7ea-7b9b36eed23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:11 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] Volume 25c28c07-94b1-43f8-ac35-d029ed9337b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25c28c07-94b1-43f8-ac35-d029ed9337b0', 'volume_size': 1} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:11 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f8a0423b-e940-4d04-a43c-dd3cec290f15 1073741824" returned: 0 in 0.663s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f8a0423b-e940-4d04-a43c-dd3cec290f15 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:11 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f8a0423b-e940-4d04-a43c-dd3cec290f15 Sep 01 08:34:11 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:12 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:34:12 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:12 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] Flow 'volume_create_manager' (4271bbea-1872-4131-b735-f263ae93b6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:12 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08d80a2-df63-4b80-9336-21996d007df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f8a0423b-e940-4d04-a43c-dd3cec290f15" returned: 0 in 0.371s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:12 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:34:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.551s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:12 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2060740571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e75d0fc9-c3f9-4c1a-8e29-f8365e38b85f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaa2631f8ae54a6cbf52988a6a344596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:10Z,use_quota=True,user_id='5af838463bb8498bbf4ae4278b83af2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:34:12 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] Creating volume e75d0fc9-c3f9-4c1a-8e29-f8365e38b85f {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:34:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:12 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:12 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:12 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:34:12 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:34:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e75d0fc9-c3f9-4c1a-8e29-f8365e38b85f 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:12 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08d80a2-df63-4b80-9336-21996d007df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-323398457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a710fd3d-a970-48c6-939c-4bcbbbde5677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaa2631f8ae54a6cbf52988a6a344596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:12Z,use_quota=True,user_id='5af838463bb8498bbf4ae4278b83af2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:12 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e75d0fc9-c3f9-4c1a-8e29-f8365e38b85f 1073741824 Sep 01 08:34:12 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:12 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3579ff3f-3d6c-4fb6-b165-b748139da549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:12 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3579ff3f-3d6c-4fb6-b165-b748139da549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:12 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7de5a24-4135-40be-b0d0-98ecd9bc3708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:12 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7de5a24-4135-40be-b0d0-98ecd9bc3708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a710fd3d-a970-48c6-939c-4bcbbbde5677', 'volume_name': 'volume-a710fd3d-a970-48c6-939c-4bcbbbde5677', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:12 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f9cab8b-82e7-47d9-9181-8bd43455d8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:12 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f9cab8b-82e7-47d9-9181-8bd43455d8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:12 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75630888-18d1-4696-9e8a-4dbb92ef3f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:12 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] Volume a710fd3d-a970-48c6-939c-4bcbbbde5677: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a710fd3d-a970-48c6-939c-4bcbbbde5677', 'volume_size': 1} Sep 01 08:34:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:12 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a25daa8-da3f-4687-9490-eff394d21ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8a0423b-e940-4d04-a43c-dd3cec290f15', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:12 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7844d7f-e5c9-4e41-8723-eb3589bfb513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:12 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Volume volume-f8a0423b-e940-4d04-a43c-dd3cec290f15 (f8a0423b-e940-4d04-a43c-dd3cec290f15): created successfully Sep 01 08:34:12 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7844d7f-e5c9-4e41-8723-eb3589bfb513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:12 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Flow 'volume_create_manager' (a06d5d51-e100-4626-bf49-1699cd4f3674) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:12 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-7dcc2682-1f41-40b1-9ece-af70208fb6ca tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Created volume successfully. Sep 01 08:34:12 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e75d0fc9-c3f9-4c1a-8e29-f8365e38b85f 1073741824" returned: 0 in 0.515s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e75d0fc9-c3f9-4c1a-8e29-f8365e38b85f {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:12 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e75d0fc9-c3f9-4c1a-8e29-f8365e38b85f Sep 01 08:34:12 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:13 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e75d0fc9-c3f9-4c1a-8e29-f8365e38b85f" returned: 0 in 0.371s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:13 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:34:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.738s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:13 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1163581757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f1de825-9519-4d1f-82b6-6dfd5946114e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaa2631f8ae54a6cbf52988a6a344596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:11Z,use_quota=True,user_id='5af838463bb8498bbf4ae4278b83af2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:34:13 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] Creating volume 9f1de825-9519-4d1f-82b6-6dfd5946114e {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:34:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:13 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:13 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:13 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:34:13 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:34:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9f1de825-9519-4d1f-82b6-6dfd5946114e 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:13 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e658bf8d-bf88-45a4-8e63-8b6220f4ee49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e75d0fc9-c3f9-4c1a-8e29-f8365e38b85f', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:13 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6523625d-c450-40b0-8d3e-db8fb2eefb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:13 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9f1de825-9519-4d1f-82b6-6dfd5946114e 1073741824 Sep 01 08:34:13 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] Volume volume-e75d0fc9-c3f9-4c1a-8e29-f8365e38b85f (e75d0fc9-c3f9-4c1a-8e29-f8365e38b85f): created successfully Sep 01 08:34:13 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:13 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6523625d-c450-40b0-8d3e-db8fb2eefb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:13 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] Flow 'volume_create_manager' (346b0cef-77b1-4d35-b611-1bf949a83d8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:13 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-1c70a87c-62dd-46b0-b4b8-d8dca3f918c7 tempest-CreateVolumesFromImageTest-443328476 None] Created volume successfully. Sep 01 08:34:13 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9f1de825-9519-4d1f-82b6-6dfd5946114e 1073741824" returned: 0 in 0.603s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9f1de825-9519-4d1f-82b6-6dfd5946114e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:13 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9f1de825-9519-4d1f-82b6-6dfd5946114e Sep 01 08:34:13 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:13 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:34:13 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Flow 'volume_create_manager' (441d4ed5-ac6e-4b8d-b68c-2ea188928413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:13 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4cfb1d-3835-4f3d-9976-aa1a3f708f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4cfb1d-3835-4f3d-9976-aa1a3f708f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-750496488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d842902-f377-4fba-8a63-10dabeaae813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9acd52b8e17a4c54b5ae533ef4a60d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:14Z,use_quota=True,user_id='9800cc386580413fa5de08b5392d4078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f8cc71-446f-4f29-be41-2a145a5dbe4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f8cc71-446f-4f29-be41-2a145a5dbe4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c115cee-de27-4667-b06b-d2c930ee988f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c115cee-de27-4667-b06b-d2c930ee988f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d842902-f377-4fba-8a63-10dabeaae813', 'volume_name': 'volume-9d842902-f377-4fba-8a63-10dabeaae813', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17bd6bf8-dbb2-480d-886a-56dd2953e707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17bd6bf8-dbb2-480d-886a-56dd2953e707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c93c84-3259-470c-9167-fbf2b0411976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:14 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Volume 9d842902-f377-4fba-8a63-10dabeaae813: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d842902-f377-4fba-8a63-10dabeaae813', 'volume_size': 1} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:14 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9f1de825-9519-4d1f-82b6-6dfd5946114e" returned: 0 in 0.346s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.421s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-210818487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25c28c07-94b1-43f8-ac35-d029ed9337b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaa2631f8ae54a6cbf52988a6a344596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:12Z,use_quota=True,user_id='5af838463bb8498bbf4ae4278b83af2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] Creating volume 25c28c07-94b1-43f8-ac35-d029ed9337b0 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:34:14 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-25c28c07-94b1-43f8-ac35-d029ed9337b0 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:14 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-25c28c07-94b1-43f8-ac35-d029ed9337b0 1073741824 Sep 01 08:34:14 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b24e44e-101b-472b-8b25-2c6f66eab58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f1de825-9519-4d1f-82b6-6dfd5946114e', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3977e86-7270-4ce7-8d60-56e04f3f01a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:14 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] Volume volume-9f1de825-9519-4d1f-82b6-6dfd5946114e (9f1de825-9519-4d1f-82b6-6dfd5946114e): created successfully Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3977e86-7270-4ce7-8d60-56e04f3f01a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] Flow 'volume_create_manager' (aab39d83-ff95-44dc-a14f-fccd861855a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:14 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-d93d06b5-511d-45a0-be4d-3bb10cf01902 tempest-CreateVolumesFromImageTest-443328476 None] Created volume successfully. Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Flow 'volume_create_manager' (2f3aff33-20ef-4197-a30b-b7c07530934b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07b7869-8848-4218-8035-69886fd00e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07b7869-8848-4218-8035-69886fd00e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2100485127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc981249-85fc-42b1-aca9-abf31a474c5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9acd52b8e17a4c54b5ae533ef4a60d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:14Z,use_quota=True,user_id='9800cc386580413fa5de08b5392d4078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae39affd-e342-4ba7-9d2b-d377b70818ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae39affd-e342-4ba7-9d2b-d377b70818ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be75923a-7918-4366-8922-efaff9e137fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be75923a-7918-4366-8922-efaff9e137fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc981249-85fc-42b1-aca9-abf31a474c5c', 'volume_name': 'volume-cc981249-85fc-42b1-aca9-abf31a474c5c', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd537780-9b75-42e6-97f2-41ad32c823a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd537780-9b75-42e6-97f2-41ad32c823a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49bc00ae-d2cc-4518-9f4f-fda46913efbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:14 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Volume cc981249-85fc-42b1-aca9-abf31a474c5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc981249-85fc-42b1-aca9-abf31a474c5c', 'volume_size': 1} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:14 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-25c28c07-94b1-43f8-ac35-d029ed9337b0 1073741824" returned: 0 in 0.624s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-25c28c07-94b1-43f8-ac35-d029ed9337b0 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:14 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-25c28c07-94b1-43f8-ac35-d029ed9337b0 Sep 01 08:34:14 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Flow 'volume_create_manager' (de94b432-1738-42d4-bd6a-111511f469e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c63c3055-2e21-4a09-aac9-f177aa5199cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c63c3055-2e21-4a09-aac9-f177aa5199cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1915762293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f77ad77-281c-43cb-89d9-8acc3a10de85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9acd52b8e17a4c54b5ae533ef4a60d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:15Z,use_quota=True,user_id='9800cc386580413fa5de08b5392d4078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77467bda-31eb-47b4-92a3-890c1de7beef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77467bda-31eb-47b4-92a3-890c1de7beef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ef93eb-d2a5-4489-9468-f306b0b5e6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ef93eb-d2a5-4489-9468-f306b0b5e6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f77ad77-281c-43cb-89d9-8acc3a10de85', 'volume_name': 'volume-0f77ad77-281c-43cb-89d9-8acc3a10de85', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91305dd2-a951-45cd-9258-255122f13a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91305dd2-a951-45cd-9258-255122f13a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb3d532-6f22-446f-9634-2a5841bb7d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:15 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Volume 0f77ad77-281c-43cb-89d9-8acc3a10de85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f77ad77-281c-43cb-89d9-8acc3a10de85', 'volume_size': 1} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:15 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-25c28c07-94b1-43f8-ac35-d029ed9337b0" returned: 0 in 0.371s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.938s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-323398457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a710fd3d-a970-48c6-939c-4bcbbbde5677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaa2631f8ae54a6cbf52988a6a344596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:12Z,use_quota=True,user_id='5af838463bb8498bbf4ae4278b83af2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] Creating volume a710fd3d-a970-48c6-939c-4bcbbbde5677 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:34:15 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a710fd3d-a970-48c6-939c-4bcbbbde5677 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c18730a2-8e7b-4a3a-b7ea-7b9b36eed23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25c28c07-94b1-43f8-ac35-d029ed9337b0', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:15 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a710fd3d-a970-48c6-939c-4bcbbbde5677 1073741824 Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97eb6384-4d45-4f41-a3d2-0665de41d0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:15 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:15 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] Volume volume-25c28c07-94b1-43f8-ac35-d029ed9337b0 (25c28c07-94b1-43f8-ac35-d029ed9337b0): created successfully Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97eb6384-4d45-4f41-a3d2-0665de41d0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] Flow 'volume_create_manager' (1a2a1afb-a438-49ff-8a03-ce9139330402) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:15 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-f1bfb336-ba12-4155-b37e-6d331152f142 tempest-CreateVolumesFromImageTest-443328476 None] Created volume successfully. Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Flow 'volume_create_manager' (6e198752-762b-43c6-8909-2f903e4d7ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4ccc876-1b10-4b04-9217-7ef71aff4fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4ccc876-1b10-4b04-9217-7ef71aff4fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1412203222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efc83e43-14cf-4a78-91df-acc5435efa10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9acd52b8e17a4c54b5ae533ef4a60d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:15Z,use_quota=True,user_id='9800cc386580413fa5de08b5392d4078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac772063-7277-4f98-b093-fbfa9c0f174f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac772063-7277-4f98-b093-fbfa9c0f174f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1621da-66ee-4e6a-999b-cab3492af773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1621da-66ee-4e6a-999b-cab3492af773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efc83e43-14cf-4a78-91df-acc5435efa10', 'volume_name': 'volume-efc83e43-14cf-4a78-91df-acc5435efa10', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4abf989c-4ac6-44f5-b3d7-6f3f8b8ef578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4abf989c-4ac6-44f5-b3d7-6f3f8b8ef578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e530d1-6e64-4558-bb84-779e0f172046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:15 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Volume efc83e43-14cf-4a78-91df-acc5435efa10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efc83e43-14cf-4a78-91df-acc5435efa10', 'volume_size': 1} Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:15 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a710fd3d-a970-48c6-939c-4bcbbbde5677 1073741824" returned: 0 in 0.729s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a710fd3d-a970-48c6-939c-4bcbbbde5677 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Flow 'volume_create_manager' (3347ce09-3a3b-406a-9136-464c12d44189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:16 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a710fd3d-a970-48c6-939c-4bcbbbde5677 Sep 01 08:34:16 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be286804-9a08-45fc-8c01-3f79892ff399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be286804-9a08-45fc-8c01-3f79892ff399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25fc9253-bd16-4015-876f-38fff3ebf36a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26ca6a9927424a3c81d3f43bf1b8e8e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:16Z,use_quota=True,user_id='9f234b4c45514d118033657a23f7fae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a636f7e-5043-48ed-abf9-a6abe75cc1dd),volume_type_id=9a636f7e-5043-48ed-abf9-a6abe75cc1dd)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66730ee4-6572-41b4-a883-705dad8b8904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66730ee4-6572-41b4-a883-705dad8b8904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc11fa0-264e-4513-bf7d-170edfb682bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.image.glance [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Creating Keystone auth plugin from conf {{(pid=86893) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Flow 'volume_create_manager' (ad0a88ac-73ba-41ba-9af3-176691310645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c28a54a8-7bd8-4e4d-853b-25aa8bc7deaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c28a54a8-7bd8-4e4d-853b-25aa8bc7deaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-862658332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6649e2a6-adfa-41b2-8c17-9d55d78af564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9acd52b8e17a4c54b5ae533ef4a60d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:16Z,use_quota=True,user_id='9800cc386580413fa5de08b5392d4078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebbea6a1-f27c-4e67-a203-bb55059f6c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebbea6a1-f27c-4e67-a203-bb55059f6c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a957413b-0383-4ec7-93fa-aca682fb9bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a957413b-0383-4ec7-93fa-aca682fb9bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6649e2a6-adfa-41b2-8c17-9d55d78af564', 'volume_name': 'volume-6649e2a6-adfa-41b2-8c17-9d55d78af564', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (813b388a-98e8-4b8b-ba01-ce964da8ad7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (813b388a-98e8-4b8b-ba01-ce964da8ad7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ef934b-db0f-4c4d-8ba5-95787c7cd5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:16 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Volume 6649e2a6-adfa-41b2-8c17-9d55d78af564: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6649e2a6-adfa-41b2-8c17-9d55d78af564', 'volume_size': 1} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:16 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a710fd3d-a970-48c6-939c-4bcbbbde5677" returned: 0 in 0.382s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.350s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-750496488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d842902-f377-4fba-8a63-10dabeaae813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9acd52b8e17a4c54b5ae533ef4a60d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:14Z,use_quota=True,user_id='9800cc386580413fa5de08b5392d4078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Creating volume 9d842902-f377-4fba-8a63-10dabeaae813 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:34:16 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9d842902-f377-4fba-8a63-10dabeaae813 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75630888-18d1-4696-9e8a-4dbb92ef3f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a710fd3d-a970-48c6-939c-4bcbbbde5677', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3317ec11-136c-498b-bcac-5d5fad2a7038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:16 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9d842902-f377-4fba-8a63-10dabeaae813 1073741824 Sep 01 08:34:16 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:16 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] Volume volume-a710fd3d-a970-48c6-939c-4bcbbbde5677 (a710fd3d-a970-48c6-939c-4bcbbbde5677): created successfully Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3317ec11-136c-498b-bcac-5d5fad2a7038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] Flow 'volume_create_manager' (4271bbea-1872-4131-b735-f263ae93b6f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:16 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-ade5fe2c-de3e-434e-8722-0248c7a3fae4 tempest-CreateVolumesFromImageTest-443328476 None] Created volume successfully. Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc11fa0-264e-4513-bf7d-170edfb682bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '25fc9253-bd16-4015-876f-38fff3ebf36a', 'volume_name': 'volume-25fc9253-bd16-4015-876f-38fff3ebf36a', 'volume_size': 1, 'image_id': '4a31258d-b339-4c69-a98c-71269d1834bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a31258d-b339-4c69-a98c-71269d1834bd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8048747cb24b9558a33fb1812e07ef7d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '26ca6a9927424a3c81d3f43bf1b8e8e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5d2c899a8cf51867eb08abca0dd846293fbfe6742aab0ff7e28613f096a0bc26eaa8e106827a538b7e1c94ca950201f7f51f7e3ed0450f744a938b65e4693974', 'id': '4a31258d-b339-4c69-a98c-71269d1834bd', 'created_at': datetime.datetime(2026, 9, 1, 6, 34, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 6, 34, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a31258d-b339-4c69-a98c-71269d1834bd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea8c65a9-8653-4c74-920e-6cc56c3af607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea8c65a9-8653-4c74-920e-6cc56c3af607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16eb662-fdc1-42ee-9220-105139222625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:16 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Volume 25fc9253-bd16-4015-876f-38fff3ebf36a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-25fc9253-bd16-4015-876f-38fff3ebf36a', 'volume_size': 1, 'image_id': '4a31258d-b339-4c69-a98c-71269d1834bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a31258d-b339-4c69-a98c-71269d1834bd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8048747cb24b9558a33fb1812e07ef7d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '26ca6a9927424a3c81d3f43bf1b8e8e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5d2c899a8cf51867eb08abca0dd846293fbfe6742aab0ff7e28613f096a0bc26eaa8e106827a538b7e1c94ca950201f7f51f7e3ed0450f744a938b65e4693974', 'id': '4a31258d-b339-4c69-a98c-71269d1834bd', 'created_at': datetime.datetime(2026, 9, 1, 6, 34, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 6, 34, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a31258d-b339-4c69-a98c-71269d1834bd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Trying to clone 25fc9253-bd16-4015-876f-38fff3ebf36a from image 4a31258d-b339-4c69-a98c-71269d1834bd at location (None, [{'url': 'file:///opt/stack/data/glance/images/4a31258d-b339-4c69-a98c-71269d1834bd', 'metadata': {}}]). {{(pid=86893) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1100}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4a31258d-b339-4c69-a98c-71269d1834bd_kuo0ds4jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86893) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 08:34:16 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Image download 0.00 MB at 0.00 MB/s Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba8f256-1563-45c4-b0c1-38982ce78b1a]: (4, 'raw') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a31258d-b339-4c69-a98c-71269d1834bd_kuo0ds4jdevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:16 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a31258d-b339-4c69-a98c-71269d1834bd_kuo0ds4jdevstack@QuobyteHD Sep 01 08:34:16 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:16 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9d842902-f377-4fba-8a63-10dabeaae813 1073741824" returned: 0 in 0.525s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9d842902-f377-4fba-8a63-10dabeaae813 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:17 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9d842902-f377-4fba-8a63-10dabeaae813 Sep 01 08:34:17 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:17 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0d17ff1b-f979-46e6-98a3-29ce4fcad43c tempest-CreateVolumesFromImageTest-443328476 None] Acquiring lock "cinder-a710fd3d-a970-48c6-939c-4bcbbbde5677-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a31258d-b339-4c69-a98c-71269d1834bd_kuo0ds4jdevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a31258d-b339-4c69-a98c-71269d1834bd_kuo0ds4jdevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0d17ff1b-f979-46e6-98a3-29ce4fcad43c tempest-CreateVolumesFromImageTest-443328476 None] Lock "cinder-a710fd3d-a970-48c6-939c-4bcbbbde5677-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0d17ff1b-f979-46e6-98a3-29ce4fcad43c tempest-CreateVolumesFromImageTest-443328476 None] Acquiring lock "cinder-quobyte-a710fd3d-a970-48c6-939c-4bcbbbde5677" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0d17ff1b-f979-46e6-98a3-29ce4fcad43c tempest-CreateVolumesFromImageTest-443328476 None] Lock "cinder-quobyte-a710fd3d-a970-48c6-939c-4bcbbbde5677" acquired by "delete_volume" :: waited 0.024s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[c885701d-70f0-4995-b17d-95552e96401c]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0d17ff1b-f979-46e6-98a3-29ce4fcad43c tempest-CreateVolumesFromImageTest-443328476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a710fd3d-a970-48c6-939c-4bcbbbde5677 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:17 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a31258d-b339-4c69-a98c-71269d1834bd_kuo0ds4jdevstack@QuobyteHD Sep 01 08:34:17 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:17 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9d842902-f377-4fba-8a63-10dabeaae813" returned: 0 in 0.344s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.752s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2100485127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc981249-85fc-42b1-aca9-abf31a474c5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9acd52b8e17a4c54b5ae533ef4a60d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:14Z,use_quota=True,user_id='9800cc386580413fa5de08b5392d4078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Creating volume cc981249-85fc-42b1-aca9-abf31a474c5c {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:34:17 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cc981249-85fc-42b1-aca9-abf31a474c5c 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c93c84-3259-470c-9167-fbf2b0411976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d842902-f377-4fba-8a63-10dabeaae813', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea4be1a-dd8a-4ba4-bdce-7966d2c77076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:17 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cc981249-85fc-42b1-aca9-abf31a474c5c 1073741824 Sep 01 08:34:17 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:17 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Volume volume-9d842902-f377-4fba-8a63-10dabeaae813 (9d842902-f377-4fba-8a63-10dabeaae813): created successfully Sep 01 08:34:17 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a710fd3d-a970-48c6-939c-4bcbbbde5677 Sep 01 08:34:17 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea4be1a-dd8a-4ba4-bdce-7966d2c77076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Flow 'volume_create_manager' (441d4ed5-ac6e-4b8d-b68c-2ea188928413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:17 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-3efa99ed-08bb-40f1-9fc9-cb20229e4876 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Created volume successfully. Sep 01 08:34:17 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a31258d-b339-4c69-a98c-71269d1834bd_kuo0ds4jdevstack@QuobyteHD" returned: 1 in 0.426s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a31258d-b339-4c69-a98c-71269d1834bd_kuo0ds4jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Temporary image 4a31258d-b339-4c69-a98c-71269d1834bd is fetched for user 9f234b4c45514d118033657a23f7fae8. {{(pid=86893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ca89e1-f525-4958-9ad3-1c70b1226ea9]: (4, 'raw') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a31258d-b339-4c69-a98c-71269d1834bd_kuo0ds4jdevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:17 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0d17ff1b-f979-46e6-98a3-29ce4fcad43c tempest-CreateVolumesFromImageTest-443328476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a710fd3d-a970-48c6-939c-4bcbbbde5677" returned: 0 in 0.472s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0d17ff1b-f979-46e6-98a3-29ce4fcad43c tempest-CreateVolumesFromImageTest-443328476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a710fd3d-a970-48c6-939c-4bcbbbde5677 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:17 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a31258d-b339-4c69-a98c-71269d1834bd_kuo0ds4jdevstack@QuobyteHD Sep 01 08:34:17 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:17 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a710fd3d-a970-48c6-939c-4bcbbbde5677 Sep 01 08:34:17 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:17 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cc981249-85fc-42b1-aca9-abf31a474c5c 1073741824" returned: 0 in 0.587s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cc981249-85fc-42b1-aca9-abf31a474c5c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:18 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cc981249-85fc-42b1-aca9-abf31a474c5c Sep 01 08:34:18 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:18 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a31258d-b339-4c69-a98c-71269d1834bd_kuo0ds4jdevstack@QuobyteHD" returned: 0 in 0.422s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a31258d-b339-4c69-a98c-71269d1834bd_kuo0ds4jdevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:18 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0d17ff1b-f979-46e6-98a3-29ce4fcad43c tempest-CreateVolumesFromImageTest-443328476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a710fd3d-a970-48c6-939c-4bcbbbde5677" returned: 0 in 0.354s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0d17ff1b-f979-46e6-98a3-29ce4fcad43c tempest-CreateVolumesFromImageTest-443328476 None] Lock "cinder-quobyte-a710fd3d-a970-48c6-939c-4bcbbbde5677" released by "delete_volume" :: held 0.899s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:18 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a31258d-b339-4c69-a98c-71269d1834bd_kuo0ds4jdevstack@QuobyteHD Sep 01 08:34:18 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-0d17ff1b-f979-46e6-98a3-29ce4fcad43c tempest-CreateVolumesFromImageTest-443328476 None] Created reservations ['e94f0d48-e1fc-47ea-b32f-857fe00965b2', '1c4e95c7-8a50-4fdb-9192-79b2a3147990', '9245bd4c-150e-41b9-95c6-be804b3a60ef', 'b8d634e7-bef4-403d-aacc-b5b5e4bbc0bf'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0d17ff1b-f979-46e6-98a3-29ce4fcad43c tempest-CreateVolumesFromImageTest-443328476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0d17ff1b-f979-46e6-98a3-29ce4fcad43c tempest-CreateVolumesFromImageTest-443328476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0d17ff1b-f979-46e6-98a3-29ce4fcad43c tempest-CreateVolumesFromImageTest-443328476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0d17ff1b-f979-46e6-98a3-29ce4fcad43c tempest-CreateVolumesFromImageTest-443328476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0d17ff1b-f979-46e6-98a3-29ce4fcad43c tempest-CreateVolumesFromImageTest-443328476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0d17ff1b-f979-46e6-98a3-29ce4fcad43c tempest-CreateVolumesFromImageTest-443328476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:18 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:34:18 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:18 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cc981249-85fc-42b1-aca9-abf31a474c5c" returned: 0 in 0.442s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.309s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1915762293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f77ad77-281c-43cb-89d9-8acc3a10de85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9acd52b8e17a4c54b5ae533ef4a60d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:15Z,use_quota=True,user_id='9800cc386580413fa5de08b5392d4078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Creating volume 0f77ad77-281c-43cb-89d9-8acc3a10de85 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:34:18 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f77ad77-281c-43cb-89d9-8acc3a10de85 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:18 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a31258d-b339-4c69-a98c-71269d1834bd_kuo0ds4jdevstack@QuobyteHD" returned: 1 in 0.415s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a31258d-b339-4c69-a98c-71269d1834bd_kuo0ds4jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:18 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f77ad77-281c-43cb-89d9-8acc3a10de85 1073741824 Sep 01 08:34:18 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49bc00ae-d2cc-4518-9f4f-fda46913efbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc981249-85fc-42b1-aca9-abf31a474c5c', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f7b0f63-a1ca-48bb-abce-12c9269d3b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:18 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Volume volume-cc981249-85fc-42b1-aca9-abf31a474c5c (cc981249-85fc-42b1-aca9-abf31a474c5c): created successfully Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f7b0f63-a1ca-48bb-abce-12c9269d3b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Flow 'volume_create_manager' (2f3aff33-20ef-4197-a30b-b7c07530934b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:18 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-2d72a72b-7c67-40c8-a9f5-97c013813872 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Created volume successfully. Sep 01 08:34:18 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0d17ff1b-f979-46e6-98a3-29ce4fcad43c tempest-CreateVolumesFromImageTest-443328476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.309s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-0d17ff1b-f979-46e6-98a3-29ce4fcad43c tempest-CreateVolumesFromImageTest-443328476 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:34:18 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-0d17ff1b-f979-46e6-98a3-29ce4fcad43c tempest-CreateVolumesFromImageTest-443328476 None] Deleted volume successfully. Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0d17ff1b-f979-46e6-98a3-29ce4fcad43c tempest-CreateVolumesFromImageTest-443328476 None] Lock "cinder-a710fd3d-a970-48c6-939c-4bcbbbde5677-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:18 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f77ad77-281c-43cb-89d9-8acc3a10de85 1073741824" returned: 0 in 0.471s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f77ad77-281c-43cb-89d9-8acc3a10de85 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:19 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f77ad77-281c-43cb-89d9-8acc3a10de85 Sep 01 08:34:19 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:19 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f77ad77-281c-43cb-89d9-8acc3a10de85" returned: 0 in 0.257s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:19 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:34:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.585s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:19 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1412203222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efc83e43-14cf-4a78-91df-acc5435efa10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9acd52b8e17a4c54b5ae533ef4a60d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:15Z,use_quota=True,user_id='9800cc386580413fa5de08b5392d4078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:34:19 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Creating volume efc83e43-14cf-4a78-91df-acc5435efa10 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:34:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:19 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:19 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:19 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:34:19 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:34:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-efc83e43-14cf-4a78-91df-acc5435efa10 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb3d532-6f22-446f-9634-2a5841bb7d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f77ad77-281c-43cb-89d9-8acc3a10de85', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13736a0f-2781-4c20-848f-da0b897c4642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:19 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-efc83e43-14cf-4a78-91df-acc5435efa10 1073741824 Sep 01 08:34:19 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:19 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Volume volume-0f77ad77-281c-43cb-89d9-8acc3a10de85 (0f77ad77-281c-43cb-89d9-8acc3a10de85): created successfully Sep 01 08:34:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13736a0f-2781-4c20-848f-da0b897c4642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:19 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Flow 'volume_create_manager' (de94b432-1738-42d4-bd6a-111511f469e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:19 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-ce5b9360-10d1-4e59-946a-5a7910521abb tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Created volume successfully. Sep 01 08:34:19 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6b039637-38c3-4e6e-8a21-527844a18229 tempest-CreateVolumesFromImageTest-443328476 None] Acquiring lock "cinder-25c28c07-94b1-43f8-ac35-d029ed9337b0-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:19 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6b039637-38c3-4e6e-8a21-527844a18229 tempest-CreateVolumesFromImageTest-443328476 None] Lock "cinder-25c28c07-94b1-43f8-ac35-d029ed9337b0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:19 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6b039637-38c3-4e6e-8a21-527844a18229 tempest-CreateVolumesFromImageTest-443328476 None] Acquiring lock "cinder-quobyte-25c28c07-94b1-43f8-ac35-d029ed9337b0" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:19 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6b039637-38c3-4e6e-8a21-527844a18229 tempest-CreateVolumesFromImageTest-443328476 None] Lock "cinder-quobyte-25c28c07-94b1-43f8-ac35-d029ed9337b0" acquired by "delete_volume" :: waited 0.014s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:19 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[c988c23d-4848-42c1-bb84-789860be41c3]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6b039637-38c3-4e6e-8a21-527844a18229 tempest-CreateVolumesFromImageTest-443328476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-25c28c07-94b1-43f8-ac35-d029ed9337b0 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:19 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-25c28c07-94b1-43f8-ac35-d029ed9337b0 Sep 01 08:34:19 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:19 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-efc83e43-14cf-4a78-91df-acc5435efa10 1073741824" returned: 0 in 0.530s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-efc83e43-14cf-4a78-91df-acc5435efa10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:19 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-efc83e43-14cf-4a78-91df-acc5435efa10 Sep 01 08:34:19 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:19 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6b039637-38c3-4e6e-8a21-527844a18229 tempest-CreateVolumesFromImageTest-443328476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-25c28c07-94b1-43f8-ac35-d029ed9337b0" returned: 0 in 0.380s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6b039637-38c3-4e6e-8a21-527844a18229 tempest-CreateVolumesFromImageTest-443328476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-25c28c07-94b1-43f8-ac35-d029ed9337b0 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:19 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-25c28c07-94b1-43f8-ac35-d029ed9337b0 Sep 01 08:34:19 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:20 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-efc83e43-14cf-4a78-91df-acc5435efa10" returned: 0 in 0.278s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.743s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-862658332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6649e2a6-adfa-41b2-8c17-9d55d78af564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9acd52b8e17a4c54b5ae533ef4a60d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:16Z,use_quota=True,user_id='9800cc386580413fa5de08b5392d4078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Creating volume 6649e2a6-adfa-41b2-8c17-9d55d78af564 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:34:20 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6649e2a6-adfa-41b2-8c17-9d55d78af564 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e530d1-6e64-4558-bb84-779e0f172046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efc83e43-14cf-4a78-91df-acc5435efa10', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91845196-3b7a-42a4-84be-500b53b07510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:20 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6649e2a6-adfa-41b2-8c17-9d55d78af564 1073741824 Sep 01 08:34:20 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:20 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Volume volume-efc83e43-14cf-4a78-91df-acc5435efa10 (efc83e43-14cf-4a78-91df-acc5435efa10): created successfully Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91845196-3b7a-42a4-84be-500b53b07510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Flow 'volume_create_manager' (6e198752-762b-43c6-8909-2f903e4d7ce0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:20 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-e2c09e71-f7df-4944-95e4-079ce23036da tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Created volume successfully. Sep 01 08:34:20 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6b039637-38c3-4e6e-8a21-527844a18229 tempest-CreateVolumesFromImageTest-443328476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-25c28c07-94b1-43f8-ac35-d029ed9337b0" returned: 0 in 0.296s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6b039637-38c3-4e6e-8a21-527844a18229 tempest-CreateVolumesFromImageTest-443328476 None] Lock "cinder-quobyte-25c28c07-94b1-43f8-ac35-d029ed9337b0" released by "delete_volume" :: held 0.737s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-6b039637-38c3-4e6e-8a21-527844a18229 tempest-CreateVolumesFromImageTest-443328476 None] Created reservations ['53550f85-757d-4664-9f88-94e8530d89d1', '274ecb2d-b153-4858-8375-8de8dd93e7ec', 'c6414614-d743-43c9-89bc-9af671564755', '35455d46-06ef-4bf7-8b40-a992ccaeec6b'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6b039637-38c3-4e6e-8a21-527844a18229 tempest-CreateVolumesFromImageTest-443328476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6b039637-38c3-4e6e-8a21-527844a18229 tempest-CreateVolumesFromImageTest-443328476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6b039637-38c3-4e6e-8a21-527844a18229 tempest-CreateVolumesFromImageTest-443328476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6b039637-38c3-4e6e-8a21-527844a18229 tempest-CreateVolumesFromImageTest-443328476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6b039637-38c3-4e6e-8a21-527844a18229 tempest-CreateVolumesFromImageTest-443328476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6b039637-38c3-4e6e-8a21-527844a18229 tempest-CreateVolumesFromImageTest-443328476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:20 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:34:20 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b146b358-a00f-433e-9abf-75b64cb8f4e2 tempest-CreateVolumesFromImageTest-443328476 None] Acquiring lock "cinder-9f1de825-9519-4d1f-82b6-6dfd5946114e-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b146b358-a00f-433e-9abf-75b64cb8f4e2 tempest-CreateVolumesFromImageTest-443328476 None] Lock "cinder-9f1de825-9519-4d1f-82b6-6dfd5946114e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:20 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6b039637-38c3-4e6e-8a21-527844a18229 tempest-CreateVolumesFromImageTest-443328476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.322s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-6b039637-38c3-4e6e-8a21-527844a18229 tempest-CreateVolumesFromImageTest-443328476 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:34:20 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-6b039637-38c3-4e6e-8a21-527844a18229 tempest-CreateVolumesFromImageTest-443328476 None] Deleted volume successfully. Sep 01 08:34:20 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6649e2a6-adfa-41b2-8c17-9d55d78af564 1073741824" returned: 0 in 0.605s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b146b358-a00f-433e-9abf-75b64cb8f4e2 tempest-CreateVolumesFromImageTest-443328476 None] Acquiring lock "cinder-quobyte-9f1de825-9519-4d1f-82b6-6dfd5946114e" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6b039637-38c3-4e6e-8a21-527844a18229 tempest-CreateVolumesFromImageTest-443328476 None] Lock "cinder-25c28c07-94b1-43f8-ac35-d029ed9337b0-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b146b358-a00f-433e-9abf-75b64cb8f4e2 tempest-CreateVolumesFromImageTest-443328476 None] Lock "cinder-quobyte-9f1de825-9519-4d1f-82b6-6dfd5946114e" acquired by "delete_volume" :: waited 0.029s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6649e2a6-adfa-41b2-8c17-9d55d78af564 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[449e7604-c41a-4d88-a447-1a3682fb86c1]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b146b358-a00f-433e-9abf-75b64cb8f4e2 tempest-CreateVolumesFromImageTest-443328476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9f1de825-9519-4d1f-82b6-6dfd5946114e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:20 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6649e2a6-adfa-41b2-8c17-9d55d78af564 Sep 01 08:34:20 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:20 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9f1de825-9519-4d1f-82b6-6dfd5946114e Sep 01 08:34:20 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:21 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6649e2a6-adfa-41b2-8c17-9d55d78af564" returned: 0 in 0.261s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.571s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25fc9253-bd16-4015-876f-38fff3ebf36a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26ca6a9927424a3c81d3f43bf1b8e8e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:16Z,use_quota=True,user_id='9f234b4c45514d118033657a23f7fae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a636f7e-5043-48ed-abf9-a6abe75cc1dd),volume_type_id=9a636f7e-5043-48ed-abf9-a6abe75cc1dd)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Creating volume 25fc9253-bd16-4015-876f-38fff3ebf36a {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:34:21 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-25fc9253-bd16-4015-876f-38fff3ebf36a 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ef934b-db0f-4c4d-8ba5-95787c7cd5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6649e2a6-adfa-41b2-8c17-9d55d78af564', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (037a6c97-5d3a-4e37-8ec0-f52859c49af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:21 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-25fc9253-bd16-4015-876f-38fff3ebf36a 1073741824 Sep 01 08:34:21 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:21 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Volume volume-6649e2a6-adfa-41b2-8c17-9d55d78af564 (6649e2a6-adfa-41b2-8c17-9d55d78af564): created successfully Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (037a6c97-5d3a-4e37-8ec0-f52859c49af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Flow 'volume_create_manager' (ad0a88ac-73ba-41ba-9af3-176691310645) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:21 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-8f56fbbf-ca91-424a-8efb-c84b5725607e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Created volume successfully. Sep 01 08:34:21 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b146b358-a00f-433e-9abf-75b64cb8f4e2 tempest-CreateVolumesFromImageTest-443328476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9f1de825-9519-4d1f-82b6-6dfd5946114e" returned: 0 in 0.479s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b146b358-a00f-433e-9abf-75b64cb8f4e2 tempest-CreateVolumesFromImageTest-443328476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9f1de825-9519-4d1f-82b6-6dfd5946114e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:21 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9f1de825-9519-4d1f-82b6-6dfd5946114e Sep 01 08:34:21 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] Flow 'volume_create_manager' (b3e3e456-cf68-4dcd-a25a-beaf3f15ca9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (606edf38-b491-4c39-9cf6-2b6516656012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (606edf38-b491-4c39-9cf6-2b6516656012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1282685347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=150eeefd-bd20-42b2-8f79-405513f77b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202114cc791a41438d1e695b30e89cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:21Z,use_quota=True,user_id='e2699a722d7b45218fb76d09d327ca8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f62d924-d410-4bc0-9771-88ef71fcae1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f62d924-d410-4bc0-9771-88ef71fcae1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9778ab40-b03e-46eb-bbe6-87d7a1677e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9778ab40-b03e-46eb-bbe6-87d7a1677e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '150eeefd-bd20-42b2-8f79-405513f77b77', 'volume_name': 'volume-150eeefd-bd20-42b2-8f79-405513f77b77', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d383efe-353a-4874-9f7f-b898aef97c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d383efe-353a-4874-9f7f-b898aef97c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccc939b1-7bcf-4610-b87f-259645a6dfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:21 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] Volume 150eeefd-bd20-42b2-8f79-405513f77b77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-150eeefd-bd20-42b2-8f79-405513f77b77', 'volume_size': 1} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:21 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b146b358-a00f-433e-9abf-75b64cb8f4e2 tempest-CreateVolumesFromImageTest-443328476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9f1de825-9519-4d1f-82b6-6dfd5946114e" returned: 0 in 0.271s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b146b358-a00f-433e-9abf-75b64cb8f4e2 tempest-CreateVolumesFromImageTest-443328476 None] Lock "cinder-quobyte-9f1de825-9519-4d1f-82b6-6dfd5946114e" released by "delete_volume" :: held 0.791s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:21 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-25fc9253-bd16-4015-876f-38fff3ebf36a 1073741824" returned: 0 in 0.531s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-b146b358-a00f-433e-9abf-75b64cb8f4e2 tempest-CreateVolumesFromImageTest-443328476 None] Created reservations ['6954480c-b7bf-4702-8f86-d8db46a23f9a', 'dedd4e22-6599-44c1-9012-c875a4c95393', '31294fb0-f729-46a0-860e-d37e96f45e0a', '73022ed3-7e9c-4d82-ae8b-aab34ea994b4'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-25fc9253-bd16-4015-876f-38fff3ebf36a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:21 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-25fc9253-bd16-4015-876f-38fff3ebf36a Sep 01 08:34:21 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b146b358-a00f-433e-9abf-75b64cb8f4e2 tempest-CreateVolumesFromImageTest-443328476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b146b358-a00f-433e-9abf-75b64cb8f4e2 tempest-CreateVolumesFromImageTest-443328476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b146b358-a00f-433e-9abf-75b64cb8f4e2 tempest-CreateVolumesFromImageTest-443328476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b146b358-a00f-433e-9abf-75b64cb8f4e2 tempest-CreateVolumesFromImageTest-443328476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b146b358-a00f-433e-9abf-75b64cb8f4e2 tempest-CreateVolumesFromImageTest-443328476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b146b358-a00f-433e-9abf-75b64cb8f4e2 tempest-CreateVolumesFromImageTest-443328476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:21 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:34:21 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ba2afbb5-53fd-4547-a11c-9fc2bb29dbdd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Acquiring lock "cinder-6649e2a6-adfa-41b2-8c17-9d55d78af564-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ba2afbb5-53fd-4547-a11c-9fc2bb29dbdd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "cinder-6649e2a6-adfa-41b2-8c17-9d55d78af564-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-03cb9bd6-4ef5-4de4-a8ea-5c20edfcdbfb tempest-CreateVolumesFromImageTest-443328476 None] Acquiring lock "cinder-e75d0fc9-c3f9-4c1a-8e29-f8365e38b85f-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ba2afbb5-53fd-4547-a11c-9fc2bb29dbdd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Acquiring lock "cinder-quobyte-6649e2a6-adfa-41b2-8c17-9d55d78af564" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-03cb9bd6-4ef5-4de4-a8ea-5c20edfcdbfb tempest-CreateVolumesFromImageTest-443328476 None] Lock "cinder-e75d0fc9-c3f9-4c1a-8e29-f8365e38b85f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ba2afbb5-53fd-4547-a11c-9fc2bb29dbdd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "cinder-quobyte-6649e2a6-adfa-41b2-8c17-9d55d78af564" acquired by "delete_volume" :: waited 0.032s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e75cbea-f8c6-424e-8ee4-4e2074afa1e7]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ba2afbb5-53fd-4547-a11c-9fc2bb29dbdd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6649e2a6-adfa-41b2-8c17-9d55d78af564 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:22 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-03cb9bd6-4ef5-4de4-a8ea-5c20edfcdbfb tempest-CreateVolumesFromImageTest-443328476 None] Acquiring lock "cinder-quobyte-e75d0fc9-c3f9-4c1a-8e29-f8365e38b85f" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-25fc9253-bd16-4015-876f-38fff3ebf36a" returned: 0 in 0.339s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.488s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1282685347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=150eeefd-bd20-42b2-8f79-405513f77b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202114cc791a41438d1e695b30e89cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:21Z,use_quota=True,user_id='e2699a722d7b45218fb76d09d327ca8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] Creating volume 150eeefd-bd20-42b2-8f79-405513f77b77 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:34:22 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-150eeefd-bd20-42b2-8f79-405513f77b77 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:22 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-150eeefd-bd20-42b2-8f79-405513f77b77 1073741824 Sep 01 08:34:22 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-03cb9bd6-4ef5-4de4-a8ea-5c20edfcdbfb tempest-CreateVolumesFromImageTest-443328476 None] Lock "cinder-quobyte-e75d0fc9-c3f9-4c1a-8e29-f8365e38b85f" acquired by "delete_volume" :: waited 0.059s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:22 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b146b358-a00f-433e-9abf-75b64cb8f4e2 tempest-CreateVolumesFromImageTest-443328476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.360s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-b146b358-a00f-433e-9abf-75b64cb8f4e2 tempest-CreateVolumesFromImageTest-443328476 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:34:22 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-b146b358-a00f-433e-9abf-75b64cb8f4e2 tempest-CreateVolumesFromImageTest-443328476 None] Deleted volume successfully. Sep 01 08:34:22 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6649e2a6-adfa-41b2-8c17-9d55d78af564 Sep 01 08:34:22 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG cinder.volume.volume_utils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Attempting download of 4a31258d-b339-4c69-a98c-71269d1834bd ((None, [{'url': 'file:///opt/stack/data/glance/images/4a31258d-b339-4c69-a98c-71269d1834bd', 'metadata': {}}])) to volume 25fc9253-bd16-4015-876f-38fff3ebf36a. {{(pid=86893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10aad89-7fbb-4237-b2d7-e6b58e8f233a]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-03cb9bd6-4ef5-4de4-a8ea-5c20edfcdbfb tempest-CreateVolumesFromImageTest-443328476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e75d0fc9-c3f9-4c1a-8e29-f8365e38b85f {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b146b358-a00f-433e-9abf-75b64cb8f4e2 tempest-CreateVolumesFromImageTest-443328476 None] Lock "cinder-9f1de825-9519-4d1f-82b6-6dfd5946114e-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[39dc088e-3530-4b58-82d1-c8b153af7c60]: (4, 'raw') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a31258d-b339-4c69-a98c-71269d1834bd_c6nfrict {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:22 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e75d0fc9-c3f9-4c1a-8e29-f8365e38b85f Sep 01 08:34:22 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:22 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a31258d-b339-4c69-a98c-71269d1834bd_c6nfrict Sep 01 08:34:22 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:22 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ba2afbb5-53fd-4547-a11c-9fc2bb29dbdd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6649e2a6-adfa-41b2-8c17-9d55d78af564" returned: 0 in 0.466s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ba2afbb5-53fd-4547-a11c-9fc2bb29dbdd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6649e2a6-adfa-41b2-8c17-9d55d78af564 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:22 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6649e2a6-adfa-41b2-8c17-9d55d78af564 Sep 01 08:34:22 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:22 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-150eeefd-bd20-42b2-8f79-405513f77b77 1073741824" returned: 0 in 0.514s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:22 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a31258d-b339-4c69-a98c-71269d1834bd_c6nfrict" returned: 0 in 0.363s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a31258d-b339-4c69-a98c-71269d1834bd_c6nfrict {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-150eeefd-bd20-42b2-8f79-405513f77b77 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:22 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-150eeefd-bd20-42b2-8f79-405513f77b77 Sep 01 08:34:22 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:22 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-03cb9bd6-4ef5-4de4-a8ea-5c20edfcdbfb tempest-CreateVolumesFromImageTest-443328476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e75d0fc9-c3f9-4c1a-8e29-f8365e38b85f" returned: 0 in 0.526s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-03cb9bd6-4ef5-4de4-a8ea-5c20edfcdbfb tempest-CreateVolumesFromImageTest-443328476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e75d0fc9-c3f9-4c1a-8e29-f8365e38b85f {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:22 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a31258d-b339-4c69-a98c-71269d1834bd_c6nfrict Sep 01 08:34:22 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:22 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e75d0fc9-c3f9-4c1a-8e29-f8365e38b85f Sep 01 08:34:22 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:22 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ba2afbb5-53fd-4547-a11c-9fc2bb29dbdd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-6649e2a6-adfa-41b2-8c17-9d55d78af564" returned: 0 in 0.290s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ba2afbb5-53fd-4547-a11c-9fc2bb29dbdd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "cinder-quobyte-6649e2a6-adfa-41b2-8c17-9d55d78af564" released by "delete_volume" :: held 0.815s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-ba2afbb5-53fd-4547-a11c-9fc2bb29dbdd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Created reservations ['fe482325-7c33-4246-b240-401a261ab33e', '6616ea50-43b9-45da-9824-bce240bfddea', '290e592f-4c98-4cd2-9075-697c0f84db88', '52e71d5d-1cc1-40fa-a860-35d380f1700a'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ba2afbb5-53fd-4547-a11c-9fc2bb29dbdd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ba2afbb5-53fd-4547-a11c-9fc2bb29dbdd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ba2afbb5-53fd-4547-a11c-9fc2bb29dbdd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:22 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ba2afbb5-53fd-4547-a11c-9fc2bb29dbdd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ba2afbb5-53fd-4547-a11c-9fc2bb29dbdd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ba2afbb5-53fd-4547-a11c-9fc2bb29dbdd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-150eeefd-bd20-42b2-8f79-405513f77b77" returned: 0 in 0.287s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:22 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccc939b1-7bcf-4610-b87f-259645a6dfab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-150eeefd-bd20-42b2-8f79-405513f77b77', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:22 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c673e1-35f3-4979-9755-7b04d5d7d5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:22 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:22 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] Volume volume-150eeefd-bd20-42b2-8f79-405513f77b77 (150eeefd-bd20-42b2-8f79-405513f77b77): created successfully Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c673e1-35f3-4979-9755-7b04d5d7d5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] Flow 'volume_create_manager' (b3e3e456-cf68-4dcd-a25a-beaf3f15ca9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-03cb9bd6-4ef5-4de4-a8ea-5c20edfcdbfb tempest-CreateVolumesFromImageTest-443328476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e75d0fc9-c3f9-4c1a-8e29-f8365e38b85f" returned: 0 in 0.316s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:22 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a31258d-b339-4c69-a98c-71269d1834bd_c6nfrict" returned: 1 in 0.425s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a31258d-b339-4c69-a98c-71269d1834bd_c6nfrict' failed. Not Retrying. {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b11bf28-3bdd-4a38-ab0a-4c216f5fe847]: (4, 'raw') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a31258d-b339-4c69-a98c-71269d1834bd_kuo0ds4jdevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-03cb9bd6-4ef5-4de4-a8ea-5c20edfcdbfb tempest-CreateVolumesFromImageTest-443328476 None] Lock "cinder-quobyte-e75d0fc9-c3f9-4c1a-8e29-f8365e38b85f" released by "delete_volume" :: held 0.936s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:23 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-3ec0bd87-0642-466e-a45a-f0d5888b3a37 tempest-ProjectReaderTests-639362596 None] Created volume successfully. Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-75b7682d-ce7b-4112-b90b-cd5e50d05429 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Acquiring lock "cinder-efc83e43-14cf-4a78-91df-acc5435efa10-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-75b7682d-ce7b-4112-b90b-cd5e50d05429 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "cinder-efc83e43-14cf-4a78-91df-acc5435efa10-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-03cb9bd6-4ef5-4de4-a8ea-5c20edfcdbfb tempest-CreateVolumesFromImageTest-443328476 None] Created reservations ['1a1cd12a-14b3-4d38-9b4f-7b412b050c60', '06c32329-7168-449b-b7f2-e751753c2444', 'd05028dd-137c-4046-adec-2494d947816d', '77d7c987-3ef9-4808-8730-604789031b8b'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-75b7682d-ce7b-4112-b90b-cd5e50d05429 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Acquiring lock "cinder-quobyte-efc83e43-14cf-4a78-91df-acc5435efa10" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-75b7682d-ce7b-4112-b90b-cd5e50d05429 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "cinder-quobyte-efc83e43-14cf-4a78-91df-acc5435efa10" acquired by "delete_volume" :: waited 0.026s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:23 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a31258d-b339-4c69-a98c-71269d1834bd_kuo0ds4jdevstack@QuobyteHD Sep 01 08:34:23 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12f5cad-c464-4c41-a996-988076003aeb]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-75b7682d-ce7b-4112-b90b-cd5e50d05429 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-efc83e43-14cf-4a78-91df-acc5435efa10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:23 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-03cb9bd6-4ef5-4de4-a8ea-5c20edfcdbfb tempest-CreateVolumesFromImageTest-443328476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-03cb9bd6-4ef5-4de4-a8ea-5c20edfcdbfb tempest-CreateVolumesFromImageTest-443328476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-03cb9bd6-4ef5-4de4-a8ea-5c20edfcdbfb tempest-CreateVolumesFromImageTest-443328476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-03cb9bd6-4ef5-4de4-a8ea-5c20edfcdbfb tempest-CreateVolumesFromImageTest-443328476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-03cb9bd6-4ef5-4de4-a8ea-5c20edfcdbfb tempest-CreateVolumesFromImageTest-443328476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-03cb9bd6-4ef5-4de4-a8ea-5c20edfcdbfb tempest-CreateVolumesFromImageTest-443328476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ba2afbb5-53fd-4547-a11c-9fc2bb29dbdd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.401s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-ba2afbb5-53fd-4547-a11c-9fc2bb29dbdd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:34:23 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-ba2afbb5-53fd-4547-a11c-9fc2bb29dbdd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Deleted volume successfully. Sep 01 08:34:23 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:34:23 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ba2afbb5-53fd-4547-a11c-9fc2bb29dbdd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "cinder-6649e2a6-adfa-41b2-8c17-9d55d78af564-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:23 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-efc83e43-14cf-4a78-91df-acc5435efa10 Sep 01 08:34:23 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:23 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a31258d-b339-4c69-a98c-71269d1834bd_kuo0ds4jdevstack@QuobyteHD" returned: 0 in 0.470s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a31258d-b339-4c69-a98c-71269d1834bd_kuo0ds4jdevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:23 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-03cb9bd6-4ef5-4de4-a8ea-5c20edfcdbfb tempest-CreateVolumesFromImageTest-443328476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.264s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-03cb9bd6-4ef5-4de4-a8ea-5c20edfcdbfb tempest-CreateVolumesFromImageTest-443328476 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:34:23 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-03cb9bd6-4ef5-4de4-a8ea-5c20edfcdbfb tempest-CreateVolumesFromImageTest-443328476 None] Deleted volume successfully. Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-03cb9bd6-4ef5-4de4-a8ea-5c20edfcdbfb tempest-CreateVolumesFromImageTest-443328476 None] Lock "cinder-e75d0fc9-c3f9-4c1a-8e29-f8365e38b85f-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:23 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a31258d-b339-4c69-a98c-71269d1834bd_kuo0ds4jdevstack@QuobyteHD Sep 01 08:34:23 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:23 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-75b7682d-ce7b-4112-b90b-cd5e50d05429 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-efc83e43-14cf-4a78-91df-acc5435efa10" returned: 0 in 0.459s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-75b7682d-ce7b-4112-b90b-cd5e50d05429 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-efc83e43-14cf-4a78-91df-acc5435efa10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:23 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-efc83e43-14cf-4a78-91df-acc5435efa10 Sep 01 08:34:23 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-fc3884cf-4ca8-49dd-84ed-3bbdff4236e7 tempest-ProjectReaderTests-639362596 None] Acquiring lock "cinder-150eeefd-bd20-42b2-8f79-405513f77b77-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-fc3884cf-4ca8-49dd-84ed-3bbdff4236e7 tempest-ProjectReaderTests-639362596 None] Lock "cinder-150eeefd-bd20-42b2-8f79-405513f77b77-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:23 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a31258d-b339-4c69-a98c-71269d1834bd_kuo0ds4jdevstack@QuobyteHD" returned: 1 in 0.379s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a31258d-b339-4c69-a98c-71269d1834bd_kuo0ds4jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] 4a31258d-b339-4c69-a98c-71269d1834bd was raw, converting to qcow2 {{(pid=86893) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4a31258d-b339-4c69-a98c-71269d1834bd_kuo0ds4jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-25fc9253-bd16-4015-876f-38fff3ebf36a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-fc3884cf-4ca8-49dd-84ed-3bbdff4236e7 tempest-ProjectReaderTests-639362596 None] Acquiring lock "cinder-quobyte-150eeefd-bd20-42b2-8f79-405513f77b77" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:23 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4a31258d-b339-4c69-a98c-71269d1834bd_kuo0ds4jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-25fc9253-bd16-4015-876f-38fff3ebf36a Sep 01 08:34:23 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-fc3884cf-4ca8-49dd-84ed-3bbdff4236e7 tempest-ProjectReaderTests-639362596 None] Lock "cinder-quobyte-150eeefd-bd20-42b2-8f79-405513f77b77" acquired by "delete_volume" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[115ceab8-fc4c-46d0-a33f-488fdecb73e6]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fc3884cf-4ca8-49dd-84ed-3bbdff4236e7 tempest-ProjectReaderTests-639362596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-150eeefd-bd20-42b2-8f79-405513f77b77 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:23 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-75b7682d-ce7b-4112-b90b-cd5e50d05429 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-efc83e43-14cf-4a78-91df-acc5435efa10" returned: 0 in 0.301s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-75b7682d-ce7b-4112-b90b-cd5e50d05429 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "cinder-quobyte-efc83e43-14cf-4a78-91df-acc5435efa10" released by "delete_volume" :: held 0.807s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:24 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-150eeefd-bd20-42b2-8f79-405513f77b77 Sep 01 08:34:24 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-75b7682d-ce7b-4112-b90b-cd5e50d05429 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Created reservations ['d5892c9d-20d6-4ae6-9ab9-cb6dfea43807', 'b77007fc-0175-4447-8027-028cc69751e0', '6a381521-23be-4dc4-a86a-1e819d5d28b8', '3939529f-f82e-473c-b9a9-62103d2e6049'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-75b7682d-ce7b-4112-b90b-cd5e50d05429 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-75b7682d-ce7b-4112-b90b-cd5e50d05429 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-75b7682d-ce7b-4112-b90b-cd5e50d05429 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-75b7682d-ce7b-4112-b90b-cd5e50d05429 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-75b7682d-ce7b-4112-b90b-cd5e50d05429 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-75b7682d-ce7b-4112-b90b-cd5e50d05429 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4340e086-3859-42ba-b5e0-7cf97d52b4fa tempest-CreateVolumesFromImageTest-443328476 None] Acquiring lock "cinder-7618a1b9-6cb3-4ec3-9358-b779bda14e84-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:24 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:34:24 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4340e086-3859-42ba-b5e0-7cf97d52b4fa tempest-CreateVolumesFromImageTest-443328476 None] Lock "cinder-7618a1b9-6cb3-4ec3-9358-b779bda14e84-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7fd327b6-7851-4343-ad1c-10d8e2f0902e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Acquiring lock "cinder-0f77ad77-281c-43cb-89d9-8acc3a10de85-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4340e086-3859-42ba-b5e0-7cf97d52b4fa tempest-CreateVolumesFromImageTest-443328476 None] Acquiring lock "cinder-quobyte-7618a1b9-6cb3-4ec3-9358-b779bda14e84" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7fd327b6-7851-4343-ad1c-10d8e2f0902e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "cinder-0f77ad77-281c-43cb-89d9-8acc3a10de85-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4340e086-3859-42ba-b5e0-7cf97d52b4fa tempest-CreateVolumesFromImageTest-443328476 None] Lock "cinder-quobyte-7618a1b9-6cb3-4ec3-9358-b779bda14e84" acquired by "delete_volume" :: waited 0.046s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7fd327b6-7851-4343-ad1c-10d8e2f0902e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Acquiring lock "cinder-quobyte-0f77ad77-281c-43cb-89d9-8acc3a10de85" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[417b41e8-04e1-4e6e-94ff-59449a97ab10]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4340e086-3859-42ba-b5e0-7cf97d52b4fa tempest-CreateVolumesFromImageTest-443328476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7618a1b9-6cb3-4ec3-9358-b779bda14e84 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:24 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fc3884cf-4ca8-49dd-84ed-3bbdff4236e7 tempest-ProjectReaderTests-639362596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-150eeefd-bd20-42b2-8f79-405513f77b77" returned: 0 in 0.495s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fc3884cf-4ca8-49dd-84ed-3bbdff4236e7 tempest-ProjectReaderTests-639362596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-150eeefd-bd20-42b2-8f79-405513f77b77 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7fd327b6-7851-4343-ad1c-10d8e2f0902e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "cinder-quobyte-0f77ad77-281c-43cb-89d9-8acc3a10de85" acquired by "delete_volume" :: waited 0.055s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:24 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-150eeefd-bd20-42b2-8f79-405513f77b77 Sep 01 08:34:24 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:24 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cde173-d0f0-4353-88cd-a44078f9aea0]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7fd327b6-7851-4343-ad1c-10d8e2f0902e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f77ad77-281c-43cb-89d9-8acc3a10de85 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4a31258d-b339-4c69-a98c-71269d1834bd_kuo0ds4jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-25fc9253-bd16-4015-876f-38fff3ebf36a" returned: 0 in 0.660s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4a31258d-b339-4c69-a98c-71269d1834bd_kuo0ds4jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-25fc9253-bd16-4015-876f-38fff3ebf36a {{(pid=86893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 08:34:24 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-25fc9253-bd16-4015-876f-38fff3ebf36a 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:24 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7618a1b9-6cb3-4ec3-9358-b779bda14e84 Sep 01 08:34:24 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:24 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-25fc9253-bd16-4015-876f-38fff3ebf36a 1G Sep 01 08:34:24 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:24 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-75b7682d-ce7b-4112-b90b-cd5e50d05429 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.429s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-75b7682d-ce7b-4112-b90b-cd5e50d05429 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:34:24 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-75b7682d-ce7b-4112-b90b-cd5e50d05429 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Deleted volume successfully. Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-75b7682d-ce7b-4112-b90b-cd5e50d05429 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "cinder-efc83e43-14cf-4a78-91df-acc5435efa10-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:24 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f77ad77-281c-43cb-89d9-8acc3a10de85 Sep 01 08:34:24 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:24 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fc3884cf-4ca8-49dd-84ed-3bbdff4236e7 tempest-ProjectReaderTests-639362596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-150eeefd-bd20-42b2-8f79-405513f77b77" returned: 0 in 0.331s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-fc3884cf-4ca8-49dd-84ed-3bbdff4236e7 tempest-ProjectReaderTests-639362596 None] Lock "cinder-quobyte-150eeefd-bd20-42b2-8f79-405513f77b77" released by "delete_volume" :: held 0.875s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-fc3884cf-4ca8-49dd-84ed-3bbdff4236e7 tempest-ProjectReaderTests-639362596 None] Created reservations ['14628d58-1fd3-4ed8-9b71-1bd90bac1896', '011bb522-0f08-4335-992b-c4b6800a6005', '958a96b6-468e-4c3d-b8e2-f7887b178214', 'c1a4ccc4-5b48-4f38-a51b-8a19b65d60cb'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:34:24 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4340e086-3859-42ba-b5e0-7cf97d52b4fa tempest-CreateVolumesFromImageTest-443328476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7618a1b9-6cb3-4ec3-9358-b779bda14e84" returned: 0 in 0.484s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4340e086-3859-42ba-b5e0-7cf97d52b4fa tempest-CreateVolumesFromImageTest-443328476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7618a1b9-6cb3-4ec3-9358-b779bda14e84 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:24 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-25fc9253-bd16-4015-876f-38fff3ebf36a 1G" returned: 0 in 0.375s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG cinder.volume.volume_utils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Downloaded image 4a31258d-b339-4c69-a98c-71269d1834bd ((None, [{'url': 'file:///opt/stack/data/glance/images/4a31258d-b339-4c69-a98c-71269d1834bd', 'metadata': {}}])) to volume 25fc9253-bd16-4015-876f-38fff3ebf36a successfully. {{(pid=86893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Temporary image 4a31258d-b339-4c69-a98c-71269d1834bd for user 9f234b4c45514d118033657a23f7fae8 is deleted. {{(pid=86893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG cinder.volume.volume_utils [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Marking volume 25fc9253-bd16-4015-876f-38fff3ebf36a as bootable. {{(pid=86893) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 08:34:24 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7618a1b9-6cb3-4ec3-9358-b779bda14e84 Sep 01 08:34:24 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Copying metadata from image 4a31258d-b339-4c69-a98c-71269d1834bd to 25fc9253-bd16-4015-876f-38fff3ebf36a. {{(pid=86893) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Creating volume glance metadata for volume 25fc9253-bd16-4015-876f-38fff3ebf36a backed by image 4a31258d-b339-4c69-a98c-71269d1834bd with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '4a31258d-b339-4c69-a98c-71269d1834bd', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '8048747cb24b9558a33fb1812e07ef7d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86893) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-fc3884cf-4ca8-49dd-84ed-3bbdff4236e7 tempest-ProjectReaderTests-639362596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-fc3884cf-4ca8-49dd-84ed-3bbdff4236e7 tempest-ProjectReaderTests-639362596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-fc3884cf-4ca8-49dd-84ed-3bbdff4236e7 tempest-ProjectReaderTests-639362596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-fc3884cf-4ca8-49dd-84ed-3bbdff4236e7 tempest-ProjectReaderTests-639362596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-fc3884cf-4ca8-49dd-84ed-3bbdff4236e7 tempest-ProjectReaderTests-639362596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fc3884cf-4ca8-49dd-84ed-3bbdff4236e7 tempest-ProjectReaderTests-639362596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:24 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7fd327b6-7851-4343-ad1c-10d8e2f0902e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f77ad77-281c-43cb-89d9-8acc3a10de85" returned: 0 in 0.484s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7fd327b6-7851-4343-ad1c-10d8e2f0902e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f77ad77-281c-43cb-89d9-8acc3a10de85 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:24 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:34:24 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:25 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f77ad77-281c-43cb-89d9-8acc3a10de85 Sep 01 08:34:25 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16eb662-fdc1-42ee-9220-105139222625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25fc9253-bd16-4015-876f-38fff3ebf36a', 'volume_size': 1, 'image_id': '4a31258d-b339-4c69-a98c-71269d1834bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a31258d-b339-4c69-a98c-71269d1834bd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8048747cb24b9558a33fb1812e07ef7d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '26ca6a9927424a3c81d3f43bf1b8e8e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5d2c899a8cf51867eb08abca0dd846293fbfe6742aab0ff7e28613f096a0bc26eaa8e106827a538b7e1c94ca950201f7f51f7e3ed0450f744a938b65e4693974', 'id': '4a31258d-b339-4c69-a98c-71269d1834bd', 'created_at': datetime.datetime(2026, 9, 1, 6, 34, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 6, 34, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a31258d-b339-4c69-a98c-71269d1834bd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a2bec0c-b99d-4f54-bb32-8a503f9a52a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:25 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Volume volume-25fc9253-bd16-4015-876f-38fff3ebf36a (25fc9253-bd16-4015-876f-38fff3ebf36a): created successfully Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a2bec0c-b99d-4f54-bb32-8a503f9a52a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Flow 'volume_create_manager' (3347ce09-3a3b-406a-9136-464c12d44189) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:25 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-0008ae00-5635-468d-816c-18395143f524 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Created volume successfully. Sep 01 08:34:25 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4340e086-3859-42ba-b5e0-7cf97d52b4fa tempest-CreateVolumesFromImageTest-443328476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7618a1b9-6cb3-4ec3-9358-b779bda14e84" returned: 0 in 0.316s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4340e086-3859-42ba-b5e0-7cf97d52b4fa tempest-CreateVolumesFromImageTest-443328476 None] Lock "cinder-quobyte-7618a1b9-6cb3-4ec3-9358-b779bda14e84" released by "delete_volume" :: held 0.856s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:25 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fc3884cf-4ca8-49dd-84ed-3bbdff4236e7 tempest-ProjectReaderTests-639362596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.345s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-fc3884cf-4ca8-49dd-84ed-3bbdff4236e7 tempest-ProjectReaderTests-639362596 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:34:25 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-fc3884cf-4ca8-49dd-84ed-3bbdff4236e7 tempest-ProjectReaderTests-639362596 None] Deleted volume successfully. Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-4340e086-3859-42ba-b5e0-7cf97d52b4fa tempest-CreateVolumesFromImageTest-443328476 None] Created reservations ['e3891663-b06b-4744-8a8a-e3b1d7988673', 'de494476-4925-4ad8-8810-db81d7c616bf', '817878be-9b8b-495e-9bc6-0f6667a2bb92', '8edf0ec0-4ffc-48ac-894d-1d74becaaffb'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-fc3884cf-4ca8-49dd-84ed-3bbdff4236e7 tempest-ProjectReaderTests-639362596 None] Lock "cinder-150eeefd-bd20-42b2-8f79-405513f77b77-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:25 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7fd327b6-7851-4343-ad1c-10d8e2f0902e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f77ad77-281c-43cb-89d9-8acc3a10de85" returned: 0 in 0.421s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7fd327b6-7851-4343-ad1c-10d8e2f0902e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "cinder-quobyte-0f77ad77-281c-43cb-89d9-8acc3a10de85" released by "delete_volume" :: held 0.989s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4340e086-3859-42ba-b5e0-7cf97d52b4fa tempest-CreateVolumesFromImageTest-443328476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4340e086-3859-42ba-b5e0-7cf97d52b4fa tempest-CreateVolumesFromImageTest-443328476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4340e086-3859-42ba-b5e0-7cf97d52b4fa tempest-CreateVolumesFromImageTest-443328476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4340e086-3859-42ba-b5e0-7cf97d52b4fa tempest-CreateVolumesFromImageTest-443328476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4340e086-3859-42ba-b5e0-7cf97d52b4fa tempest-CreateVolumesFromImageTest-443328476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4340e086-3859-42ba-b5e0-7cf97d52b4fa tempest-CreateVolumesFromImageTest-443328476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:25 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:34:25 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-7fd327b6-7851-4343-ad1c-10d8e2f0902e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Created reservations ['03f31c38-9c35-4729-bbd1-054b1ec0f7d7', 'b593cfbf-2161-4f21-9336-fcec0cc72695', '2b4b4f58-38fe-424e-9934-28c6919e7d5c', 'bc442cd8-dc0b-4bb5-bb19-a5b329b74bf6'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] Flow 'volume_create_manager' (5f6df514-083e-4afc-a1c5-eb677a39b599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1d88377-e05e-4547-9ac6-b2300667a893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1d88377-e05e-4547-9ac6-b2300667a893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-119721483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2086b0ee-9c11-4901-8e58-c1539f528a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202114cc791a41438d1e695b30e89cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:26Z,use_quota=True,user_id='e2699a722d7b45218fb76d09d327ca8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5cc3600-447d-40d9-ad75-725e85102290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5cc3600-447d-40d9-ad75-725e85102290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00bd573d-4713-42f3-8dd2-c21f0d0b40da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00bd573d-4713-42f3-8dd2-c21f0d0b40da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2086b0ee-9c11-4901-8e58-c1539f528a98', 'volume_name': 'volume-2086b0ee-9c11-4901-8e58-c1539f528a98', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37413f5e-1b79-448a-a581-8d503e3f2271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37413f5e-1b79-448a-a581-8d503e3f2271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (706f26f0-ea0f-46ad-8b1a-7216f781b830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:25 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] Volume 2086b0ee-9c11-4901-8e58-c1539f528a98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2086b0ee-9c11-4901-8e58-c1539f528a98', 'volume_size': 1} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-119721483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2086b0ee-9c11-4901-8e58-c1539f528a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202114cc791a41438d1e695b30e89cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:26Z,use_quota=True,user_id='e2699a722d7b45218fb76d09d327ca8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] Creating volume 2086b0ee-9c11-4901-8e58-c1539f528a98 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:34:25 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2086b0ee-9c11-4901-8e58-c1539f528a98 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-30921cf3-7881-44a4-846d-860895be8852 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Acquiring lock "cinder-25fc9253-bd16-4015-876f-38fff3ebf36a-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:25 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2086b0ee-9c11-4901-8e58-c1539f528a98 1073741824 Sep 01 08:34:25 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:25 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-30921cf3-7881-44a4-846d-860895be8852 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Lock "cinder-25fc9253-bd16-4015-876f-38fff3ebf36a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4340e086-3859-42ba-b5e0-7cf97d52b4fa tempest-CreateVolumesFromImageTest-443328476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.297s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-4340e086-3859-42ba-b5e0-7cf97d52b4fa tempest-CreateVolumesFromImageTest-443328476 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7fd327b6-7851-4343-ad1c-10d8e2f0902e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7fd327b6-7851-4343-ad1c-10d8e2f0902e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7fd327b6-7851-4343-ad1c-10d8e2f0902e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7fd327b6-7851-4343-ad1c-10d8e2f0902e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7fd327b6-7851-4343-ad1c-10d8e2f0902e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7fd327b6-7851-4343-ad1c-10d8e2f0902e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:25 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-4340e086-3859-42ba-b5e0-7cf97d52b4fa tempest-CreateVolumesFromImageTest-443328476 None] Deleted volume successfully. Sep 01 08:34:25 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:34:25 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4340e086-3859-42ba-b5e0-7cf97d52b4fa tempest-CreateVolumesFromImageTest-443328476 None] Lock "cinder-7618a1b9-6cb3-4ec3-9358-b779bda14e84-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-30921cf3-7881-44a4-846d-860895be8852 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Acquiring lock "cinder-quobyte-25fc9253-bd16-4015-876f-38fff3ebf36a" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-30921cf3-7881-44a4-846d-860895be8852 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Lock "cinder-quobyte-25fc9253-bd16-4015-876f-38fff3ebf36a" acquired by "delete_volume" :: waited 0.019s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[64123993-895b-4f8b-bc4a-ec1b0a8597dd]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-30921cf3-7881-44a4-846d-860895be8852 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-25fc9253-bd16-4015-876f-38fff3ebf36a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:26 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-25fc9253-bd16-4015-876f-38fff3ebf36a Sep 01 08:34:26 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:26 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7fd327b6-7851-4343-ad1c-10d8e2f0902e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.263s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:26 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-7fd327b6-7851-4343-ad1c-10d8e2f0902e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:34:26 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-7fd327b6-7851-4343-ad1c-10d8e2f0902e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Deleted volume successfully. Sep 01 08:34:26 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7fd327b6-7851-4343-ad1c-10d8e2f0902e tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "cinder-0f77ad77-281c-43cb-89d9-8acc3a10de85-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:26 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2086b0ee-9c11-4901-8e58-c1539f528a98 1073741824" returned: 0 in 0.516s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2086b0ee-9c11-4901-8e58-c1539f528a98 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:26 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2086b0ee-9c11-4901-8e58-c1539f528a98 Sep 01 08:34:26 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:26 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-30921cf3-7881-44a4-846d-860895be8852 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-25fc9253-bd16-4015-876f-38fff3ebf36a" returned: 0 in 0.427s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-30921cf3-7881-44a4-846d-860895be8852 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-25fc9253-bd16-4015-876f-38fff3ebf36a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:26 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-25fc9253-bd16-4015-876f-38fff3ebf36a Sep 01 08:34:26 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:26 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2086b0ee-9c11-4901-8e58-c1539f528a98" returned: 0 in 0.296s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:26 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:34:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (706f26f0-ea0f-46ad-8b1a-7216f781b830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2086b0ee-9c11-4901-8e58-c1539f528a98', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f067b8-f9d8-49a3-b0ac-7fe76e77c005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:26 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-30921cf3-7881-44a4-846d-860895be8852 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-25fc9253-bd16-4015-876f-38fff3ebf36a" returned: 0 in 0.287s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:26 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e25bb137-d2e1-44eb-a69f-7d13433b6820 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Acquiring lock "cinder-cc981249-85fc-42b1-aca9-abf31a474c5c-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:26 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] Volume volume-2086b0ee-9c11-4901-8e58-c1539f528a98 (2086b0ee-9c11-4901-8e58-c1539f528a98): created successfully Sep 01 08:34:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f067b8-f9d8-49a3-b0ac-7fe76e77c005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:26 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] Flow 'volume_create_manager' (5f6df514-083e-4afc-a1c5-eb677a39b599) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:26 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-30921cf3-7881-44a4-846d-860895be8852 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Lock "cinder-quobyte-25fc9253-bd16-4015-876f-38fff3ebf36a" released by "delete_volume" :: held 0.785s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:26 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e25bb137-d2e1-44eb-a69f-7d13433b6820 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "cinder-cc981249-85fc-42b1-aca9-abf31a474c5c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:26 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-4b93a08a-a6a8-4248-b577-42d162249b61 tempest-ProjectReaderTests-639362596 None] Created volume successfully. Sep 01 08:34:26 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e25bb137-d2e1-44eb-a69f-7d13433b6820 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Acquiring lock "cinder-quobyte-cc981249-85fc-42b1-aca9-abf31a474c5c" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:26 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-30921cf3-7881-44a4-846d-860895be8852 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Created reservations ['20fcc26e-e668-48f2-9086-ebbdcbe7ecad', '534defa1-1df6-4e3d-94dd-142d70b0de3f', '05fc0967-29c2-4567-9489-97a69fc3a43e', '79121e65-4751-4e78-92b9-40a2a4387192'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:34:26 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e25bb137-d2e1-44eb-a69f-7d13433b6820 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "cinder-quobyte-cc981249-85fc-42b1-aca9-abf31a474c5c" acquired by "delete_volume" :: waited 0.027s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:26 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b4de7e-068c-4f59-a92a-7110dd1da5bf]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e25bb137-d2e1-44eb-a69f-7d13433b6820 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cc981249-85fc-42b1-aca9-abf31a474c5c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-30921cf3-7881-44a4-846d-860895be8852 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-30921cf3-7881-44a4-846d-860895be8852 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:26 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-30921cf3-7881-44a4-846d-860895be8852 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:26 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-30921cf3-7881-44a4-846d-860895be8852 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-30921cf3-7881-44a4-846d-860895be8852 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-30921cf3-7881-44a4-846d-860895be8852 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:26 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:34:26 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:26 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cc981249-85fc-42b1-aca9-abf31a474c5c Sep 01 08:34:26 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:27 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-30921cf3-7881-44a4-846d-860895be8852 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.262s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:27 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-30921cf3-7881-44a4-846d-860895be8852 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:34:27 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-30921cf3-7881-44a4-846d-860895be8852 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Deleted volume successfully. Sep 01 08:34:27 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-30921cf3-7881-44a4-846d-860895be8852 tempest-VolumeAndVolumeTypeFromImageTest-540378909 None] Lock "cinder-25fc9253-bd16-4015-876f-38fff3ebf36a-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:27 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e25bb137-d2e1-44eb-a69f-7d13433b6820 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cc981249-85fc-42b1-aca9-abf31a474c5c" returned: 0 in 0.396s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e25bb137-d2e1-44eb-a69f-7d13433b6820 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cc981249-85fc-42b1-aca9-abf31a474c5c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:27 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cc981249-85fc-42b1-aca9-abf31a474c5c Sep 01 08:34:27 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:27 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e25bb137-d2e1-44eb-a69f-7d13433b6820 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-cc981249-85fc-42b1-aca9-abf31a474c5c" returned: 0 in 0.246s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:27 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e25bb137-d2e1-44eb-a69f-7d13433b6820 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "cinder-quobyte-cc981249-85fc-42b1-aca9-abf31a474c5c" released by "delete_volume" :: held 0.698s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:27 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-e25bb137-d2e1-44eb-a69f-7d13433b6820 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Created reservations ['914106e0-d468-4f82-9af7-3f2cc73bb889', '5b8d0138-4c3e-499d-9f98-5716a046c1be', 'b1bfe34a-2b44-4646-b20b-aa745b4345ac', 'b95bc51b-0a22-40dd-8e69-103aafc26720'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:34:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e25bb137-d2e1-44eb-a69f-7d13433b6820 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e25bb137-d2e1-44eb-a69f-7d13433b6820 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e25bb137-d2e1-44eb-a69f-7d13433b6820 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:27 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e25bb137-d2e1-44eb-a69f-7d13433b6820 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e25bb137-d2e1-44eb-a69f-7d13433b6820 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e25bb137-d2e1-44eb-a69f-7d13433b6820 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:27 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:34:27 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:27 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-01482bc8-22d8-4ee6-87bb-7a829833200e tempest-ProjectReaderTests-639362596 None] Acquiring lock "cinder-2086b0ee-9c11-4901-8e58-c1539f528a98-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:27 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-01482bc8-22d8-4ee6-87bb-7a829833200e tempest-ProjectReaderTests-639362596 None] Lock "cinder-2086b0ee-9c11-4901-8e58-c1539f528a98-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:27 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-01482bc8-22d8-4ee6-87bb-7a829833200e tempest-ProjectReaderTests-639362596 None] Acquiring lock "cinder-quobyte-2086b0ee-9c11-4901-8e58-c1539f528a98" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:27 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ec0d0741-a842-4747-939d-acc70aae72dd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Acquiring lock "cinder-9d842902-f377-4fba-8a63-10dabeaae813-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:27 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ec0d0741-a842-4747-939d-acc70aae72dd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "cinder-9d842902-f377-4fba-8a63-10dabeaae813-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:27 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-01482bc8-22d8-4ee6-87bb-7a829833200e tempest-ProjectReaderTests-639362596 None] Lock "cinder-quobyte-2086b0ee-9c11-4901-8e58-c1539f528a98" acquired by "delete_volume" :: waited 0.048s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:27 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bc5147-3370-4835-ba44-dee703c3fb5c]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01482bc8-22d8-4ee6-87bb-7a829833200e tempest-ProjectReaderTests-639362596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2086b0ee-9c11-4901-8e58-c1539f528a98 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:27 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e25bb137-d2e1-44eb-a69f-7d13433b6820 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.408s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:27 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-e25bb137-d2e1-44eb-a69f-7d13433b6820 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:34:27 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-e25bb137-d2e1-44eb-a69f-7d13433b6820 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Deleted volume successfully. Sep 01 08:34:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ec0d0741-a842-4747-939d-acc70aae72dd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Acquiring lock "cinder-quobyte-9d842902-f377-4fba-8a63-10dabeaae813" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ec0d0741-a842-4747-939d-acc70aae72dd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "cinder-quobyte-9d842902-f377-4fba-8a63-10dabeaae813" acquired by "delete_volume" :: waited 0.030s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e25bb137-d2e1-44eb-a69f-7d13433b6820 tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "cinder-cc981249-85fc-42b1-aca9-abf31a474c5c-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:28 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ed223f-85a3-4bc8-8679-da07c1ce014e]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ec0d0741-a842-4747-939d-acc70aae72dd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9d842902-f377-4fba-8a63-10dabeaae813 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:28 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2086b0ee-9c11-4901-8e58-c1539f528a98 Sep 01 08:34:28 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:28 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9d842902-f377-4fba-8a63-10dabeaae813 Sep 01 08:34:28 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:28 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01482bc8-22d8-4ee6-87bb-7a829833200e tempest-ProjectReaderTests-639362596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2086b0ee-9c11-4901-8e58-c1539f528a98" returned: 0 in 0.605s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01482bc8-22d8-4ee6-87bb-7a829833200e tempest-ProjectReaderTests-639362596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2086b0ee-9c11-4901-8e58-c1539f528a98 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:28 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2086b0ee-9c11-4901-8e58-c1539f528a98 Sep 01 08:34:28 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:28 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ec0d0741-a842-4747-939d-acc70aae72dd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9d842902-f377-4fba-8a63-10dabeaae813" returned: 0 in 0.530s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ec0d0741-a842-4747-939d-acc70aae72dd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9d842902-f377-4fba-8a63-10dabeaae813 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:28 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9d842902-f377-4fba-8a63-10dabeaae813 Sep 01 08:34:28 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:28 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01482bc8-22d8-4ee6-87bb-7a829833200e tempest-ProjectReaderTests-639362596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2086b0ee-9c11-4901-8e58-c1539f528a98" returned: 0 in 0.283s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-01482bc8-22d8-4ee6-87bb-7a829833200e tempest-ProjectReaderTests-639362596 None] Lock "cinder-quobyte-2086b0ee-9c11-4901-8e58-c1539f528a98" released by "delete_volume" :: held 0.974s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:28 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-01482bc8-22d8-4ee6-87bb-7a829833200e tempest-ProjectReaderTests-639362596 None] Created reservations ['49f35a1f-cea1-469c-baed-d54cdb535db7', '3f43772f-0225-4b43-bc90-23c48ebfda28', '66ee21f2-1075-4705-bff5-c3171f6e0d47', '01789b27-15ff-4c74-ae73-74412c97a451'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:34:28 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ec0d0741-a842-4747-939d-acc70aae72dd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9d842902-f377-4fba-8a63-10dabeaae813" returned: 0 in 0.357s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ec0d0741-a842-4747-939d-acc70aae72dd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "cinder-quobyte-9d842902-f377-4fba-8a63-10dabeaae813" released by "delete_volume" :: held 0.951s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-01482bc8-22d8-4ee6-87bb-7a829833200e tempest-ProjectReaderTests-639362596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-01482bc8-22d8-4ee6-87bb-7a829833200e tempest-ProjectReaderTests-639362596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-01482bc8-22d8-4ee6-87bb-7a829833200e tempest-ProjectReaderTests-639362596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-01482bc8-22d8-4ee6-87bb-7a829833200e tempest-ProjectReaderTests-639362596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-01482bc8-22d8-4ee6-87bb-7a829833200e tempest-ProjectReaderTests-639362596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01482bc8-22d8-4ee6-87bb-7a829833200e tempest-ProjectReaderTests-639362596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:29 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:34:29 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:29 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-ec0d0741-a842-4747-939d-acc70aae72dd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Created reservations ['740e0f4b-7bb8-4531-983b-11a94a04bb80', 'cf8ed03a-c394-4548-9678-fec68725d922', '461951ec-67d1-41fe-a644-bcb5bcefc633', '0d313f01-7290-42a3-9fa2-c23ea9030702'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:34:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ec0d0741-a842-4747-939d-acc70aae72dd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ec0d0741-a842-4747-939d-acc70aae72dd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ec0d0741-a842-4747-939d-acc70aae72dd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-ec0d0741-a842-4747-939d-acc70aae72dd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ec0d0741-a842-4747-939d-acc70aae72dd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ec0d0741-a842-4747-939d-acc70aae72dd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:29 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:34:29 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:29 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01482bc8-22d8-4ee6-87bb-7a829833200e tempest-ProjectReaderTests-639362596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.298s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:29 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-01482bc8-22d8-4ee6-87bb-7a829833200e tempest-ProjectReaderTests-639362596 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:34:29 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-01482bc8-22d8-4ee6-87bb-7a829833200e tempest-ProjectReaderTests-639362596 None] Deleted volume successfully. Sep 01 08:34:29 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-01482bc8-22d8-4ee6-87bb-7a829833200e tempest-ProjectReaderTests-639362596 None] Lock "cinder-2086b0ee-9c11-4901-8e58-c1539f528a98-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:29 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ec0d0741-a842-4747-939d-acc70aae72dd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.280s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:29 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-ec0d0741-a842-4747-939d-acc70aae72dd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:34:29 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-ec0d0741-a842-4747-939d-acc70aae72dd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Deleted volume successfully. Sep 01 08:34:29 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ec0d0741-a842-4747-939d-acc70aae72dd tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "cinder-9d842902-f377-4fba-8a63-10dabeaae813-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Flow 'volume_create_manager' (ff0516cb-5a31-4253-a467-e8deaef834aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19c3eaf3-6744-4bb9-9e41-1afdc1bd8298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0a14f1b3-5f75-465c-ba7c-ff60bf71ff3f tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Acquiring lock "cinder-f8a0423b-e940-4d04-a43c-dd3cec290f15-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19c3eaf3-6744-4bb9-9e41-1afdc1bd8298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1204049450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64920481-9779-455e-8406-e32a3e1ead7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ea6499ec6f44aa9f7f9ff804d0b605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:30Z,use_quota=True,user_id='ba76a04f44054692a578ecfa04d9fa6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (932d2a75-2c1b-45e4-8741-b181d90e8bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (932d2a75-2c1b-45e4-8741-b181d90e8bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02a90664-c7db-4db9-a39b-1b1729ba1aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02a90664-c7db-4db9-a39b-1b1729ba1aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64920481-9779-455e-8406-e32a3e1ead7e', 'volume_name': 'volume-64920481-9779-455e-8406-e32a3e1ead7e', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ccd2ef-5aef-467c-9e48-99240fe5f6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ccd2ef-5aef-467c-9e48-99240fe5f6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f69516-6d38-4a69-b0b8-07e4be9ebe0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:30 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Volume 64920481-9779-455e-8406-e32a3e1ead7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64920481-9779-455e-8406-e32a3e1ead7e', 'volume_size': 1} Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1204049450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64920481-9779-455e-8406-e32a3e1ead7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ea6499ec6f44aa9f7f9ff804d0b605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:30Z,use_quota=True,user_id='ba76a04f44054692a578ecfa04d9fa6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Creating volume 64920481-9779-455e-8406-e32a3e1ead7e {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:34:30 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0a14f1b3-5f75-465c-ba7c-ff60bf71ff3f tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "cinder-f8a0423b-e940-4d04-a43c-dd3cec290f15-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:30 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e 1073741824 Sep 01 08:34:30 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0a14f1b3-5f75-465c-ba7c-ff60bf71ff3f tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Acquiring lock "cinder-quobyte-f8a0423b-e940-4d04-a43c-dd3cec290f15" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0a14f1b3-5f75-465c-ba7c-ff60bf71ff3f tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "cinder-quobyte-f8a0423b-e940-4d04-a43c-dd3cec290f15" acquired by "delete_volume" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1eed4e-9582-4fe4-a1e7-9a32d032b257]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0a14f1b3-5f75-465c-ba7c-ff60bf71ff3f tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f8a0423b-e940-4d04-a43c-dd3cec290f15 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:30 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f8a0423b-e940-4d04-a43c-dd3cec290f15 Sep 01 08:34:30 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:30 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e 1073741824" returned: 0 in 0.530s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:30 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0a14f1b3-5f75-465c-ba7c-ff60bf71ff3f tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f8a0423b-e940-4d04-a43c-dd3cec290f15" returned: 0 in 0.471s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0a14f1b3-5f75-465c-ba7c-ff60bf71ff3f tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f8a0423b-e940-4d04-a43c-dd3cec290f15 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:30 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e Sep 01 08:34:30 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:30 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f8a0423b-e940-4d04-a43c-dd3cec290f15 Sep 01 08:34:30 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:34:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:31 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:34:31 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:31 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e" returned: 0 in 0.351s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:34:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f69516-6d38-4a69-b0b8-07e4be9ebe0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64920481-9779-455e-8406-e32a3e1ead7e', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:31 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c0aa7a9-c9e6-49f2-b162-73c8653847d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0a14f1b3-5f75-465c-ba7c-ff60bf71ff3f tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f8a0423b-e940-4d04-a43c-dd3cec290f15" returned: 0 in 0.398s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:31 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Volume volume-64920481-9779-455e-8406-e32a3e1ead7e (64920481-9779-455e-8406-e32a3e1ead7e): created successfully Sep 01 08:34:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c0aa7a9-c9e6-49f2-b162-73c8653847d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Flow 'volume_create_manager' (ff0516cb-5a31-4253-a467-e8deaef834aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:31 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0a14f1b3-5f75-465c-ba7c-ff60bf71ff3f tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "cinder-quobyte-f8a0423b-e940-4d04-a43c-dd3cec290f15" released by "delete_volume" :: held 0.949s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:31 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-05c104e8-d0bd-4b50-949c-1b0e2b94010d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Created volume successfully. Sep 01 08:34:31 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-0a14f1b3-5f75-465c-ba7c-ff60bf71ff3f tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Created reservations ['3bd4c562-3d3d-48ec-ab25-fdf6d2bfbec9', '8d731d3e-449d-4d79-add1-d9cdcf5b3631', '324f349b-ef6d-4ff6-afcd-3896548f81a4', 'b884eea9-d2dc-4e98-9dd7-80468407f1e9'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:34:31 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0a14f1b3-5f75-465c-ba7c-ff60bf71ff3f tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0a14f1b3-5f75-465c-ba7c-ff60bf71ff3f tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0a14f1b3-5f75-465c-ba7c-ff60bf71ff3f tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0a14f1b3-5f75-465c-ba7c-ff60bf71ff3f tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0a14f1b3-5f75-465c-ba7c-ff60bf71ff3f tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0a14f1b3-5f75-465c-ba7c-ff60bf71ff3f tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.481s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:31 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:34:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager._thread_info {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:34:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread count: 28 {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 08:34:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread info: [<_MainThread(MainThread, started 138934582050944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 08:34:31 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:34:31 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:31 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0a14f1b3-5f75-465c-ba7c-ff60bf71ff3f tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.286s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:31 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-0a14f1b3-5f75-465c-ba7c-ff60bf71ff3f tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:34:31 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-0a14f1b3-5f75-465c-ba7c-ff60bf71ff3f tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Deleted volume successfully. Sep 01 08:34:31 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0a14f1b3-5f75-465c-ba7c-ff60bf71ff3f tempest-CreateVolumesFromSourceVolumeTest-1149629303 None] Lock "cinder-f8a0423b-e940-4d04-a43c-dd3cec290f15-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-52d4f7d6-acea-4195-b75d-c3d89a230714 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-52d4f7d6-acea-4195-b75d-c3d89a230714 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:32 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-52d4f7d6-acea-4195-b75d-c3d89a230714 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Creating offline snapshot 9d51cceb-0d03-45fe-8b84-670258e16e65 of volume 64920481-9779-455e-8406-e32a3e1ead7e {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:34:32 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec54da9a-679a-4cc3-80c6-60a34bb99251]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-52d4f7d6-acea-4195-b75d-c3d89a230714 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:32 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e Sep 01 08:34:32 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:32 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-52d4f7d6-acea-4195-b75d-c3d89a230714 tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e" returned: 0 in 0.435s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-52d4f7d6-acea-4195-b75d-c3d89a230714 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e.9d51cceb-0d03-45fe-8b84-670258e16e65 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:32 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e.9d51cceb-0d03-45fe-8b84-670258e16e65 1G Sep 01 08:34:32 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:33 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-52d4f7d6-acea-4195-b75d-c3d89a230714 tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e.9d51cceb-0d03-45fe-8b84-670258e16e65 1G" returned: 0 in 0.529s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-52d4f7d6-acea-4195-b75d-c3d89a230714 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64920481-9779-455e-8406-e32a3e1ead7e -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e.9d51cceb-0d03-45fe-8b84-670258e16e65 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:33 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64920481-9779-455e-8406-e32a3e1ead7e -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e.9d51cceb-0d03-45fe-8b84-670258e16e65 Sep 01 08:34:33 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:33 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-52d4f7d6-acea-4195-b75d-c3d89a230714 tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64920481-9779-455e-8406-e32a3e1ead7e -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e.9d51cceb-0d03-45fe-8b84-670258e16e65" returned: 0 in 0.427s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:33 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-52d4f7d6-acea-4195-b75d-c3d89a230714 tempest-CreateVolumesFromSnapshotTest-1684188918 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e.9d51cceb-0d03-45fe-8b84-670258e16e65 is being set with open permissions: ugo+rw Sep 01 08:34:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-52d4f7d6-acea-4195-b75d-c3d89a230714 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e.9d51cceb-0d03-45fe-8b84-670258e16e65 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:33 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e.9d51cceb-0d03-45fe-8b84-670258e16e65 Sep 01 08:34:33 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:34 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-52d4f7d6-acea-4195-b75d-c3d89a230714 tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e.9d51cceb-0d03-45fe-8b84-670258e16e65" returned: 0 in 0.476s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-52d4f7d6-acea-4195-b75d-c3d89a230714 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:34 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e.info Sep 01 08:34:34 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:34 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:34:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] Flow 'volume_create_manager' (78aba12d-4ae8-4e33-a6b9-7a606af2088f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa357433-2d1d-4507-baae-d260404a527d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa357433-2d1d-4507-baae-d260404a527d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc798f2-9b28-4db5-acdd-a887968c4169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781629e8aaad42529f438115104f2ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:34Z,use_quota=True,user_id='b38028c6402347e9981bc1dcff164c1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eeae655-9669-4031-af29-6868784554de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eeae655-9669-4031-af29-6868784554de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f2a548-fbd3-40d1-9ad0-3d4ff6fc030f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f2a548-fbd3-40d1-9ad0-3d4ff6fc030f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cc798f2-9b28-4db5-acdd-a887968c4169', 'volume_name': 'volume-4cc798f2-9b28-4db5-acdd-a887968c4169', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (557ba5bf-a0b7-43e4-bf76-281987eec90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (557ba5bf-a0b7-43e4-bf76-281987eec90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:34 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d08c563e-340f-49ac-ba71-37d6c18efd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:34 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] Volume 4cc798f2-9b28-4db5-acdd-a887968c4169: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cc798f2-9b28-4db5-acdd-a887968c4169', 'volume_size': 1} Sep 01 08:34:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:34 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-52d4f7d6-acea-4195-b75d-c3d89a230714 tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e.info" returned: 0 in 0.327s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:34 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-52d4f7d6-acea-4195-b75d-c3d89a230714 tempest-CreateVolumesFromSnapshotTest-1684188918 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e.info is being set with open permissions: ugo+rw Sep 01 08:34:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-52d4f7d6-acea-4195-b75d-c3d89a230714 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:34 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e.info Sep 01 08:34:34 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:34 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-52d4f7d6-acea-4195-b75d-c3d89a230714 tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e.info" returned: 0 in 0.272s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-52d4f7d6-acea-4195-b75d-c3d89a230714 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.613s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.432s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc798f2-9b28-4db5-acdd-a887968c4169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781629e8aaad42529f438115104f2ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:34Z,use_quota=True,user_id='b38028c6402347e9981bc1dcff164c1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] Creating volume 4cc798f2-9b28-4db5-acdd-a887968c4169 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:34:35 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cc798f2-9b28-4db5-acdd-a887968c4169 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:35 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cc798f2-9b28-4db5-acdd-a887968c4169 1073741824 Sep 01 08:34:35 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:35 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-52d4f7d6-acea-4195-b75d-c3d89a230714 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Create snapshot completed successfully Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] Flow 'volume_create_manager' (692763dd-ef05-45b8-98f9-56f33130006c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b200aa68-05da-457e-a234-498a73b1e155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b200aa68-05da-457e-a234-498a73b1e155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1482438697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64f17d51-964d-4908-928b-9f5246222e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef3d7e19a16458a94ec8926ac2849da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:35Z,use_quota=True,user_id='999b77df2aa046688e87487a73e33751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d80e451-9e8e-484f-bc44-6a1e8d50a3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d80e451-9e8e-484f-bc44-6a1e8d50a3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceb0dd00-4237-4ad3-8e49-8f9f6147a177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceb0dd00-4237-4ad3-8e49-8f9f6147a177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64f17d51-964d-4908-928b-9f5246222e54', 'volume_name': 'volume-64f17d51-964d-4908-928b-9f5246222e54', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:35 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a88aa5a8-54be-40dc-8fe5-e5d4865704a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a88aa5a8-54be-40dc-8fe5-e5d4865704a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd8eeaa9-7965-4119-9524-639e4cb631a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:35 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] Volume 64f17d51-964d-4908-928b-9f5246222e54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64f17d51-964d-4908-928b-9f5246222e54', 'volume_size': 1} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cc798f2-9b28-4db5-acdd-a887968c4169 1073741824" returned: 0 in 0.559s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cc798f2-9b28-4db5-acdd-a887968c4169 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:35 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cc798f2-9b28-4db5-acdd-a887968c4169 Sep 01 08:34:35 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:35 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cc798f2-9b28-4db5-acdd-a887968c4169" returned: 0 in 0.286s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.333s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1482438697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64f17d51-964d-4908-928b-9f5246222e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef3d7e19a16458a94ec8926ac2849da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:35Z,use_quota=True,user_id='999b77df2aa046688e87487a73e33751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] Creating volume 64f17d51-964d-4908-928b-9f5246222e54 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:34:35 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64f17d51-964d-4908-928b-9f5246222e54 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:35 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64f17d51-964d-4908-928b-9f5246222e54 1073741824 Sep 01 08:34:35 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:35 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d08c563e-340f-49ac-ba71-37d6c18efd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cc798f2-9b28-4db5-acdd-a887968c4169', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7218d369-a45b-4f71-9040-22378f468322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:36 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] Volume volume-4cc798f2-9b28-4db5-acdd-a887968c4169 (4cc798f2-9b28-4db5-acdd-a887968c4169): created successfully Sep 01 08:34:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7218d369-a45b-4f71-9040-22378f468322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] Flow 'volume_create_manager' (78aba12d-4ae8-4e33-a6b9-7a606af2088f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:36 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-f57faf3b-0a76-4c8e-a7e9-d25902a47ad2 tempest-CinderUnicodeTest-452759633 None] Created volume successfully. Sep 01 08:34:36 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:34:36 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] Flow 'volume_create_manager' (fe605260-793d-450a-a82c-4c7f6fbef0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09a6fc8d-008a-4466-b461-3c9eab4af9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64f17d51-964d-4908-928b-9f5246222e54 1073741824" returned: 0 in 0.621s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09a6fc8d-008a-4466-b461-3c9eab4af9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2077004035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88017f89-7bdc-4176-926b-790ea56548f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ea6499ec6f44aa9f7f9ff804d0b605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:36Z,use_quota=True,user_id='ba76a04f44054692a578ecfa04d9fa6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebe79603-73ba-4f75-a2db-c181b91f206b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebe79603-73ba-4f75-a2db-c181b91f206b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8419cc62-fb79-4477-b2f7-9775c8f577c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8419cc62-fb79-4477-b2f7-9775c8f577c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88017f89-7bdc-4176-926b-790ea56548f3', 'volume_name': 'volume-88017f89-7bdc-4176-926b-790ea56548f3', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c835120c-5110-4e87-9261-0bb06fe0d3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c835120c-5110-4e87-9261-0bb06fe0d3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:36 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8299cbc6-6f9f-4730-b506-cf37ca573310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:36 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] Volume 88017f89-7bdc-4176-926b-790ea56548f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88017f89-7bdc-4176-926b-790ea56548f3', 'volume_size': 1} Sep 01 08:34:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64f17d51-964d-4908-928b-9f5246222e54 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:36 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64f17d51-964d-4908-928b-9f5246222e54 Sep 01 08:34:36 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:36 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64f17d51-964d-4908-928b-9f5246222e54" returned: 0 in 0.314s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.344s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2077004035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88017f89-7bdc-4176-926b-790ea56548f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ea6499ec6f44aa9f7f9ff804d0b605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:36Z,use_quota=True,user_id='ba76a04f44054692a578ecfa04d9fa6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] Creating volume 88017f89-7bdc-4176-926b-790ea56548f3 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:34:37 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-88017f89-7bdc-4176-926b-790ea56548f3 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] Flow 'volume_create_manager' (5eb4a177-6443-4d07-89b6-d113100255ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:37 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-88017f89-7bdc-4176-926b-790ea56548f3 1073741824 Sep 01 08:34:37 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83deedd4-b26c-49b4-bab7-c4fef973c546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83deedd4-b26c-49b4-bab7-c4fef973c546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-669783026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16a108aa-3f12-41a4-952a-bec9928f2ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33e10d4a13ef4407be476c78bb8d5176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:37Z,use_quota=True,user_id='60ea225abafc4c928cf59c37cadf18a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc5d505-3fa0-4970-9e20-c5ce4a41961e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc5d505-3fa0-4970-9e20-c5ce4a41961e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e93a513-c741-48d2-9cb0-315de61af128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e93a513-c741-48d2-9cb0-315de61af128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16a108aa-3f12-41a4-952a-bec9928f2ac0', 'volume_name': 'volume-16a108aa-3f12-41a4-952a-bec9928f2ac0', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (414ef733-470a-4660-9abb-3ed0b2f64239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (414ef733-470a-4660-9abb-3ed0b2f64239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f2f7ba3-d0e7-4ad9-a4ff-87d45a332320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:37 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] Volume 16a108aa-3f12-41a4-952a-bec9928f2ac0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16a108aa-3f12-41a4-952a-bec9928f2ac0', 'volume_size': 1} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd8eeaa9-7965-4119-9524-639e4cb631a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64f17d51-964d-4908-928b-9f5246222e54', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67814f98-ef42-429b-a878-43a710a73fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] Flow 'volume_create_manager' (efad4ef7-eee9-405d-b57c-2f479ebdf2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc59b4a-4d85-4387-8c98-f94e244a2dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:37 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] Volume volume-64f17d51-964d-4908-928b-9f5246222e54 (64f17d51-964d-4908-928b-9f5246222e54): created successfully Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67814f98-ef42-429b-a878-43a710a73fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] Flow 'volume_create_manager' (692763dd-ef05-45b8-98f9-56f33130006c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc59b4a-4d85-4387-8c98-f94e244a2dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-989163671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ffafe1d-23f2-4818-a82b-7bc9a6ec8217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ea6499ec6f44aa9f7f9ff804d0b605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:37Z,use_quota=True,user_id='ba76a04f44054692a578ecfa04d9fa6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c68c5dfb-dcc1-4c69-9a4c-1b660eec53ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c68c5dfb-dcc1-4c69-9a4c-1b660eec53ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e2fa0f1-9db0-4e04-96fa-d37b6e6cfe88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e2fa0f1-9db0-4e04-96fa-d37b6e6cfe88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ffafe1d-23f2-4818-a82b-7bc9a6ec8217', 'volume_name': 'volume-9ffafe1d-23f2-4818-a82b-7bc9a6ec8217', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a8c51a8-f284-4760-8495-fa7ab065620e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a8c51a8-f284-4760-8495-fa7ab065620e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d425b2e3-ea9b-4b1b-82a1-b5b2a0f9f231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:37 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] Volume 9ffafe1d-23f2-4818-a82b-7bc9a6ec8217: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ffafe1d-23f2-4818-a82b-7bc9a6ec8217', 'volume_size': 1} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:37 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-8b5836fc-8c36-4ec4-8a29-776746c7815f tempest-ProjectReaderTests-2124680279 None] Created volume successfully. Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Flow 'volume_create_manager' (b553f52e-39e1-41b1-90c9-1e7344569274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f3a639-7a24-4836-96c0-768f10625d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f3a639-7a24-4836-96c0-768f10625d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-597375520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca0ab1ba-75f4-43ba-b999-3a6e1a79092a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ea6499ec6f44aa9f7f9ff804d0b605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:37Z,use_quota=True,user_id='ba76a04f44054692a578ecfa04d9fa6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9076f5a4-6c93-4e69-8996-37c4a3fa5a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9076f5a4-6c93-4e69-8996-37c4a3fa5a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b98d17cf-f000-43b4-ac47-585b2265ff31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b98d17cf-f000-43b4-ac47-585b2265ff31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca0ab1ba-75f4-43ba-b999-3a6e1a79092a', 'volume_name': 'volume-ca0ab1ba-75f4-43ba-b999-3a6e1a79092a', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c562dbda-63c1-4a43-b0cb-ba9ffca9f0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:37 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c562dbda-63c1-4a43-b0cb-ba9ffca9f0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99825bb1-61b4-485b-b225-f45cca5481fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:37 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Volume ca0ab1ba-75f4-43ba-b999-3a6e1a79092a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca0ab1ba-75f4-43ba-b999-3a6e1a79092a', 'volume_size': 1} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-88017f89-7bdc-4176-926b-790ea56548f3 1073741824" returned: 0 in 0.602s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-88017f89-7bdc-4176-926b-790ea56548f3 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:37 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-88017f89-7bdc-4176-926b-790ea56548f3 Sep 01 08:34:37 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bd984879-e8d5-45f7-8a57-92a3ca0aa4d5 tempest-ProjectReaderTests-2124680279 None] Acquiring lock "cinder-64f17d51-964d-4908-928b-9f5246222e54-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bd984879-e8d5-45f7-8a57-92a3ca0aa4d5 tempest-ProjectReaderTests-2124680279 None] Lock "cinder-64f17d51-964d-4908-928b-9f5246222e54-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Flow 'volume_create_manager' (6158f1f4-c8e3-4eb4-99af-63682c76329c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d127f6-743f-4eba-bd7a-021fbcb5d783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d127f6-743f-4eba-bd7a-021fbcb5d783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1349670255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6dfcc33-7dcb-43a9-8784-2241de34506c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ea6499ec6f44aa9f7f9ff804d0b605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:38Z,use_quota=True,user_id='ba76a04f44054692a578ecfa04d9fa6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2c1f76-9099-4465-ae40-6a0fa890c3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:37 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2c1f76-9099-4465-ae40-6a0fa890c3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9613b93f-ca10-49b2-83e3-b6c826410fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9613b93f-ca10-49b2-83e3-b6c826410fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6dfcc33-7dcb-43a9-8784-2241de34506c', 'volume_name': 'volume-a6dfcc33-7dcb-43a9-8784-2241de34506c', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c217ddd-2bef-4dce-b6cb-bcaa4fe7b277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c217ddd-2bef-4dce-b6cb-bcaa4fe7b277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a328a9-da38-4024-b364-a41ab94c36b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:37 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Volume a6dfcc33-7dcb-43a9-8784-2241de34506c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6dfcc33-7dcb-43a9-8784-2241de34506c', 'volume_size': 1} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-88017f89-7bdc-4176-926b-790ea56548f3" returned: 0 in 0.306s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.781s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-669783026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16a108aa-3f12-41a4-952a-bec9928f2ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33e10d4a13ef4407be476c78bb8d5176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:37Z,use_quota=True,user_id='60ea225abafc4c928cf59c37cadf18a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] Creating volume 16a108aa-3f12-41a4-952a-bec9928f2ac0 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:34:38 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bd984879-e8d5-45f7-8a57-92a3ca0aa4d5 tempest-ProjectReaderTests-2124680279 None] Acquiring lock "cinder-quobyte-64f17d51-964d-4908-928b-9f5246222e54" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:34:38 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0 1073741824 Sep 01 08:34:38 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] Flow 'volume_create_manager' (1496e2f1-3f0e-415c-b005-e85eb0e7bf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d07dd6a-5785-45c4-84cf-654ff39f9ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8299cbc6-6f9f-4730-b506-cf37ca573310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88017f89-7bdc-4176-926b-790ea56548f3', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77dc5d23-a077-4fc0-8a33-deffa936783c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d07dd6a-5785-45c4-84cf-654ff39f9ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1081378743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f05061ce-348e-4ae3-9764-334b777aed3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781629e8aaad42529f438115104f2ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:38Z,use_quota=True,user_id='b38028c6402347e9981bc1dcff164c1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5bc7f0f-8977-4d49-9192-4c7b495434ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5bc7f0f-8977-4d49-9192-4c7b495434ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e1aa7f-ab7d-4af1-a8f3-e71a08221988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e1aa7f-ab7d-4af1-a8f3-e71a08221988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f05061ce-348e-4ae3-9764-334b777aed3b', 'volume_name': 'volume-f05061ce-348e-4ae3-9764-334b777aed3b', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc28f0c3-23f2-49aa-bb05-6efad11c9898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc28f0c3-23f2-49aa-bb05-6efad11c9898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (234a81d6-6e3b-4b76-a08a-8e1cd0b61fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:38 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] Volume f05061ce-348e-4ae3-9764-334b777aed3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f05061ce-348e-4ae3-9764-334b777aed3b', 'volume_size': 1} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bd984879-e8d5-45f7-8a57-92a3ca0aa4d5 tempest-ProjectReaderTests-2124680279 None] Lock "cinder-quobyte-64f17d51-964d-4908-928b-9f5246222e54" acquired by "delete_volume" :: waited 0.137s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:38 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] Volume volume-88017f89-7bdc-4176-926b-790ea56548f3 (88017f89-7bdc-4176-926b-790ea56548f3): created successfully Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77dc5d23-a077-4fc0-8a33-deffa936783c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] Flow 'volume_create_manager' (fe605260-793d-450a-a82c-4c7f6fbef0bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[49496c37-e43c-4216-be35-568f373d3f03]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bd984879-e8d5-45f7-8a57-92a3ca0aa4d5 tempest-ProjectReaderTests-2124680279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64f17d51-964d-4908-928b-9f5246222e54 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Flow 'volume_create_manager' (cbc76e75-c78c-4f35-bf1a-e8b8b7c212c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29d5ef80-2e13-4f80-b89f-0327c8edeafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:38 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-88da761e-cda0-403d-8274-00a4d68412ef tempest-CreateVolumesFromSnapshotTest-1684188918 None] Created volume successfully. Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29d5ef80-2e13-4f80-b89f-0327c8edeafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1706402139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98eee67d-ccf7-41e4-9bff-ebce238f7c1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ea6499ec6f44aa9f7f9ff804d0b605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:38Z,use_quota=True,user_id='ba76a04f44054692a578ecfa04d9fa6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99d5490e-44a1-48fc-9166-802dcb76a85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99d5490e-44a1-48fc-9166-802dcb76a85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc69e0e-680f-4e68-b776-5930eb3c981f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc69e0e-680f-4e68-b776-5930eb3c981f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98eee67d-ccf7-41e4-9bff-ebce238f7c1e', 'volume_name': 'volume-98eee67d-ccf7-41e4-9bff-ebce238f7c1e', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b4cdc6e-ec9e-448c-a093-57090036782f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b4cdc6e-ec9e-448c-a093-57090036782f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd007d77-3457-440d-870c-da53afb1348a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:38 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Volume 98eee67d-ccf7-41e4-9bff-ebce238f7c1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98eee67d-ccf7-41e4-9bff-ebce238f7c1e', 'volume_size': 1} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:38 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64f17d51-964d-4908-928b-9f5246222e54 Sep 01 08:34:38 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:38 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0 1073741824" returned: 0 in 0.449s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:38 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0 Sep 01 08:34:38 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:38 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bd984879-e8d5-45f7-8a57-92a3ca0aa4d5 tempest-ProjectReaderTests-2124680279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64f17d51-964d-4908-928b-9f5246222e54" returned: 0 in 0.388s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bd984879-e8d5-45f7-8a57-92a3ca0aa4d5 tempest-ProjectReaderTests-2124680279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64f17d51-964d-4908-928b-9f5246222e54 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:38 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64f17d51-964d-4908-928b-9f5246222e54 Sep 01 08:34:38 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:38 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0" returned: 0 in 0.257s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.418s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-989163671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ffafe1d-23f2-4818-a82b-7bc9a6ec8217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ea6499ec6f44aa9f7f9ff804d0b605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:37Z,use_quota=True,user_id='ba76a04f44054692a578ecfa04d9fa6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] Creating volume 9ffafe1d-23f2-4818-a82b-7bc9a6ec8217 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:34:38 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9ffafe1d-23f2-4818-a82b-7bc9a6ec8217 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:38 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9ffafe1d-23f2-4818-a82b-7bc9a6ec8217 1073741824 Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f2f7ba3-d0e7-4ad9-a4ff-87d45a332320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16a108aa-3f12-41a4-952a-bec9928f2ac0', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:38 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c82381b-609c-4f13-9420-06dba159c23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:38 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] Volume volume-16a108aa-3f12-41a4-952a-bec9928f2ac0 (16a108aa-3f12-41a4-952a-bec9928f2ac0): created successfully Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c82381b-609c-4f13-9420-06dba159c23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] Flow 'volume_create_manager' (5eb4a177-6443-4d07-89b6-d113100255ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:38 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bd984879-e8d5-45f7-8a57-92a3ca0aa4d5 tempest-ProjectReaderTests-2124680279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64f17d51-964d-4908-928b-9f5246222e54" returned: 0 in 0.263s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:38 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-119fe710-5563-4df1-9c56-bd3d353bc398 tempest-VolumeDependencyTests-208774870 None] Created volume successfully. Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bd984879-e8d5-45f7-8a57-92a3ca0aa4d5 tempest-ProjectReaderTests-2124680279 None] Lock "cinder-quobyte-64f17d51-964d-4908-928b-9f5246222e54" released by "delete_volume" :: held 0.716s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-bd984879-e8d5-45f7-8a57-92a3ca0aa4d5 tempest-ProjectReaderTests-2124680279 None] Created reservations ['d0a9fd25-3a80-4c75-9e52-8be90de9e2ca', '96606283-ac65-46c7-9071-ecea3d14313c', '7da10c01-1207-4234-8b00-658f19c2b440', 'b5c67990-7f46-4a99-be1a-03e0b60e3068'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bd984879-e8d5-45f7-8a57-92a3ca0aa4d5 tempest-ProjectReaderTests-2124680279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bd984879-e8d5-45f7-8a57-92a3ca0aa4d5 tempest-ProjectReaderTests-2124680279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bd984879-e8d5-45f7-8a57-92a3ca0aa4d5 tempest-ProjectReaderTests-2124680279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bd984879-e8d5-45f7-8a57-92a3ca0aa4d5 tempest-ProjectReaderTests-2124680279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bd984879-e8d5-45f7-8a57-92a3ca0aa4d5 tempest-ProjectReaderTests-2124680279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bd984879-e8d5-45f7-8a57-92a3ca0aa4d5 tempest-ProjectReaderTests-2124680279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:39 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:34:39 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:39 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bd984879-e8d5-45f7-8a57-92a3ca0aa4d5 tempest-ProjectReaderTests-2124680279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.274s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:39 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-bd984879-e8d5-45f7-8a57-92a3ca0aa4d5 tempest-ProjectReaderTests-2124680279 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:34:39 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-bd984879-e8d5-45f7-8a57-92a3ca0aa4d5 tempest-ProjectReaderTests-2124680279 None] Deleted volume successfully. Sep 01 08:34:39 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9ffafe1d-23f2-4818-a82b-7bc9a6ec8217 1073741824" returned: 0 in 0.525s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:39 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-bd984879-e8d5-45f7-8a57-92a3ca0aa4d5 tempest-ProjectReaderTests-2124680279 None] Lock "cinder-64f17d51-964d-4908-928b-9f5246222e54-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9ffafe1d-23f2-4818-a82b-7bc9a6ec8217 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:39 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9ffafe1d-23f2-4818-a82b-7bc9a6ec8217 Sep 01 08:34:39 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-69a1ff70-44aa-4096-8eb8-67bd9cfe722d tempest-VolumeDependencyTests-208774870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:39 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9ffafe1d-23f2-4818-a82b-7bc9a6ec8217" returned: 0 in 0.266s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:34:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.968s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-597375520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca0ab1ba-75f4-43ba-b999-3a6e1a79092a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ea6499ec6f44aa9f7f9ff804d0b605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:37Z,use_quota=True,user_id='ba76a04f44054692a578ecfa04d9fa6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:34:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Creating volume ca0ab1ba-75f4-43ba-b999-3a6e1a79092a {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:34:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:34:39 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:34:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ca0ab1ba-75f4-43ba-b999-3a6e1a79092a 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:39 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ca0ab1ba-75f4-43ba-b999-3a6e1a79092a 1073741824 Sep 01 08:34:39 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d425b2e3-ea9b-4b1b-82a1-b5b2a0f9f231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ffafe1d-23f2-4818-a82b-7bc9a6ec8217', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df8096f1-52d5-479c-b9b1-309c433b3bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:39 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] Volume volume-9ffafe1d-23f2-4818-a82b-7bc9a6ec8217 (9ffafe1d-23f2-4818-a82b-7bc9a6ec8217): created successfully Sep 01 08:34:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df8096f1-52d5-479c-b9b1-309c433b3bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] Flow 'volume_create_manager' (efad4ef7-eee9-405d-b57c-2f479ebdf2ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:39 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-3b724262-26d0-478a-8011-51a24363494a tempest-CreateVolumesFromSnapshotTest-1684188918 None] Created volume successfully. Sep 01 08:34:40 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ca0ab1ba-75f4-43ba-b999-3a6e1a79092a 1073741824" returned: 0 in 0.436s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ca0ab1ba-75f4-43ba-b999-3a6e1a79092a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:40 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ca0ab1ba-75f4-43ba-b999-3a6e1a79092a Sep 01 08:34:40 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:40 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ca0ab1ba-75f4-43ba-b999-3a6e1a79092a" returned: 0 in 0.282s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.381s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1349670255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6dfcc33-7dcb-43a9-8784-2241de34506c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ea6499ec6f44aa9f7f9ff804d0b605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:38Z,use_quota=True,user_id='ba76a04f44054692a578ecfa04d9fa6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Creating volume a6dfcc33-7dcb-43a9-8784-2241de34506c {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:34:40 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a6dfcc33-7dcb-43a9-8784-2241de34506c 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99825bb1-61b4-485b-b225-f45cca5481fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca0ab1ba-75f4-43ba-b999-3a6e1a79092a', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce8ec68-fdbf-48cb-842c-721f743151de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:40 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a6dfcc33-7dcb-43a9-8784-2241de34506c 1073741824 Sep 01 08:34:40 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:40 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Volume volume-ca0ab1ba-75f4-43ba-b999-3a6e1a79092a (ca0ab1ba-75f4-43ba-b999-3a6e1a79092a): created successfully Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce8ec68-fdbf-48cb-842c-721f743151de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Flow 'volume_create_manager' (b553f52e-39e1-41b1-90c9-1e7344569274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:40 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-0232f7f6-4347-4c0c-8acc-d43ff7ea6865 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Created volume successfully. Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] Flow 'volume_create_manager' (24bbc9b9-8f73-47d7-ae47-2ea232298063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed3c090-fede-49f4-b43b-a29413517094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed3c090-fede-49f4-b43b-a29413517094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1116217166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e82c356a-638b-4154-a836-6b4aa59364ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef3d7e19a16458a94ec8926ac2849da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:41Z,use_quota=True,user_id='999b77df2aa046688e87487a73e33751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5286c43-d877-4617-9e2b-59fdbeeb62a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5286c43-d877-4617-9e2b-59fdbeeb62a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (836f950a-bc00-41fd-8b30-b04e415677fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (836f950a-bc00-41fd-8b30-b04e415677fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e82c356a-638b-4154-a836-6b4aa59364ba', 'volume_name': 'volume-e82c356a-638b-4154-a836-6b4aa59364ba', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50106c7f-b3bf-4c91-a3fd-81a8a22c5fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50106c7f-b3bf-4c91-a3fd-81a8a22c5fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68fce71e-b219-454b-867e-6b23a3818b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:40 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] Volume e82c356a-638b-4154-a836-6b4aa59364ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e82c356a-638b-4154-a836-6b4aa59364ba', 'volume_size': 1} Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:40 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a6dfcc33-7dcb-43a9-8784-2241de34506c 1073741824" returned: 0 in 0.451s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a6dfcc33-7dcb-43a9-8784-2241de34506c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:40 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a6dfcc33-7dcb-43a9-8784-2241de34506c Sep 01 08:34:40 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:41 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a6dfcc33-7dcb-43a9-8784-2241de34506c" returned: 0 in 0.251s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.957s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1081378743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f05061ce-348e-4ae3-9764-334b777aed3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781629e8aaad42529f438115104f2ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:38Z,use_quota=True,user_id='b38028c6402347e9981bc1dcff164c1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] Creating volume f05061ce-348e-4ae3-9764-334b777aed3b {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:34:41 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a328a9-da38-4024-b364-a41ab94c36b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6dfcc33-7dcb-43a9-8784-2241de34506c', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:41 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b 1073741824 Sep 01 08:34:41 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02f7115-6eb9-4563-a5a4-f3ea957f89ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:41 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Volume volume-a6dfcc33-7dcb-43a9-8784-2241de34506c (a6dfcc33-7dcb-43a9-8784-2241de34506c): created successfully Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02f7115-6eb9-4563-a5a4-f3ea957f89ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Flow 'volume_create_manager' (6158f1f4-c8e3-4eb4-99af-63682c76329c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:41 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-aaabb3b4-cd8d-400f-80d2-dda5c742387d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Created volume successfully. Sep 01 08:34:41 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b 1073741824" returned: 0 in 0.448s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:41 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b Sep 01 08:34:41 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:41 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b" returned: 0 in 0.240s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.532s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1706402139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98eee67d-ccf7-41e4-9bff-ebce238f7c1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ea6499ec6f44aa9f7f9ff804d0b605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:38Z,use_quota=True,user_id='ba76a04f44054692a578ecfa04d9fa6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Creating volume 98eee67d-ccf7-41e4-9bff-ebce238f7c1e {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:34:41 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98eee67d-ccf7-41e4-9bff-ebce238f7c1e 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (234a81d6-6e3b-4b76-a08a-8e1cd0b61fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f05061ce-348e-4ae3-9764-334b777aed3b', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54162f2d-a1fc-460a-a3b5-de2f0a289ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:41 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98eee67d-ccf7-41e4-9bff-ebce238f7c1e 1073741824 Sep 01 08:34:41 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:41 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] Volume volume-f05061ce-348e-4ae3-9764-334b777aed3b (f05061ce-348e-4ae3-9764-334b777aed3b): created successfully Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54162f2d-a1fc-460a-a3b5-de2f0a289ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:41 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] Flow 'volume_create_manager' (1496e2f1-3f0e-415c-b005-e85eb0e7bf3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:41 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-340cd091-f7fa-4cad-a105-37f839685577 tempest-CinderUnicodeTest-452759633 None] Created volume successfully. Sep 01 08:34:42 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98eee67d-ccf7-41e4-9bff-ebce238f7c1e 1073741824" returned: 0 in 0.401s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98eee67d-ccf7-41e4-9bff-ebce238f7c1e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:42 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98eee67d-ccf7-41e4-9bff-ebce238f7c1e Sep 01 08:34:42 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:42 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98eee67d-ccf7-41e4-9bff-ebce238f7c1e" returned: 0 in 0.277s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:34:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-69a1ff70-44aa-4096-8eb8-67bd9cfe722d tempest-VolumeDependencyTests-208774870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.069s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-69a1ff70-44aa-4096-8eb8-67bd9cfe722d tempest-VolumeDependencyTests-208774870 None] Creating offline snapshot 4ad25cc3-7485-4a49-94e2-ed9871ab3f96 of volume 16a108aa-3f12-41a4-952a-bec9928f2ac0 {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:34:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd007d77-3457-440d-870c-da53afb1348a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98eee67d-ccf7-41e4-9bff-ebce238f7c1e', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf217581-1d69-43db-9484-6989d42167ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:42 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[238c66c4-665b-475f-b5e9-48b1ed1dd01c]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-69a1ff70-44aa-4096-8eb8-67bd9cfe722d tempest-VolumeDependencyTests-208774870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:42 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Volume volume-98eee67d-ccf7-41e4-9bff-ebce238f7c1e (98eee67d-ccf7-41e4-9bff-ebce238f7c1e): created successfully Sep 01 08:34:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf217581-1d69-43db-9484-6989d42167ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:42 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Flow 'volume_create_manager' (cbc76e75-c78c-4f35-bf1a-e8b8b7c212c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:42 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-9abf898b-121f-4bc3-b908-4ee4d222ee43 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Created volume successfully. Sep 01 08:34:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-964940ba-4031-4d8f-a7ac-ab1b73561de1 tempest-CinderUnicodeTest-452759633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:42 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0 Sep 01 08:34:42 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:43 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-69a1ff70-44aa-4096-8eb8-67bd9cfe722d tempest-VolumeDependencyTests-208774870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0" returned: 0 in 0.381s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-69a1ff70-44aa-4096-8eb8-67bd9cfe722d tempest-VolumeDependencyTests-208774870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0.4ad25cc3-7485-4a49-94e2-ed9871ab3f96 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:43 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0.4ad25cc3-7485-4a49-94e2-ed9871ab3f96 1G Sep 01 08:34:43 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:43 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-69a1ff70-44aa-4096-8eb8-67bd9cfe722d tempest-VolumeDependencyTests-208774870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0.4ad25cc3-7485-4a49-94e2-ed9871ab3f96 1G" returned: 0 in 0.381s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-69a1ff70-44aa-4096-8eb8-67bd9cfe722d tempest-VolumeDependencyTests-208774870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16a108aa-3f12-41a4-952a-bec9928f2ac0 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0.4ad25cc3-7485-4a49-94e2-ed9871ab3f96 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:43 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16a108aa-3f12-41a4-952a-bec9928f2ac0 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0.4ad25cc3-7485-4a49-94e2-ed9871ab3f96 Sep 01 08:34:43 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:43 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3e821f81-bbfc-43c7-b619-79bc07e845c7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "cinder-98eee67d-ccf7-41e4-9bff-ebce238f7c1e-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:43 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-69a1ff70-44aa-4096-8eb8-67bd9cfe722d tempest-VolumeDependencyTests-208774870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16a108aa-3f12-41a4-952a-bec9928f2ac0 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0.4ad25cc3-7485-4a49-94e2-ed9871ab3f96" returned: 0 in 0.311s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:43 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-69a1ff70-44aa-4096-8eb8-67bd9cfe722d tempest-VolumeDependencyTests-208774870 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0.4ad25cc3-7485-4a49-94e2-ed9871ab3f96 is being set with open permissions: ugo+rw Sep 01 08:34:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-69a1ff70-44aa-4096-8eb8-67bd9cfe722d tempest-VolumeDependencyTests-208774870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0.4ad25cc3-7485-4a49-94e2-ed9871ab3f96 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:43 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3e821f81-bbfc-43c7-b619-79bc07e845c7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "cinder-98eee67d-ccf7-41e4-9bff-ebce238f7c1e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:43 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0.4ad25cc3-7485-4a49-94e2-ed9871ab3f96 Sep 01 08:34:43 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:43 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3e821f81-bbfc-43c7-b619-79bc07e845c7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "cinder-quobyte-98eee67d-ccf7-41e4-9bff-ebce238f7c1e" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:43 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3e821f81-bbfc-43c7-b619-79bc07e845c7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "cinder-quobyte-98eee67d-ccf7-41e4-9bff-ebce238f7c1e" acquired by "delete_volume" :: waited 0.016s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:43 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e25e7dc-e96f-40ab-827c-6607b9e82567]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3e821f81-bbfc-43c7-b619-79bc07e845c7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98eee67d-ccf7-41e4-9bff-ebce238f7c1e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:43 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98eee67d-ccf7-41e4-9bff-ebce238f7c1e Sep 01 08:34:43 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:43 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-69a1ff70-44aa-4096-8eb8-67bd9cfe722d tempest-VolumeDependencyTests-208774870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0.4ad25cc3-7485-4a49-94e2-ed9871ab3f96" returned: 0 in 0.258s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-69a1ff70-44aa-4096-8eb8-67bd9cfe722d tempest-VolumeDependencyTests-208774870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:44 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0.info Sep 01 08:34:44 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:44 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3e821f81-bbfc-43c7-b619-79bc07e845c7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98eee67d-ccf7-41e4-9bff-ebce238f7c1e" returned: 0 in 0.371s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3e821f81-bbfc-43c7-b619-79bc07e845c7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98eee67d-ccf7-41e4-9bff-ebce238f7c1e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:44 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98eee67d-ccf7-41e4-9bff-ebce238f7c1e Sep 01 08:34:44 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:44 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-69a1ff70-44aa-4096-8eb8-67bd9cfe722d tempest-VolumeDependencyTests-208774870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0.info" returned: 0 in 0.249s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:44 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-69a1ff70-44aa-4096-8eb8-67bd9cfe722d tempest-VolumeDependencyTests-208774870 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0.info is being set with open permissions: ugo+rw Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-69a1ff70-44aa-4096-8eb8-67bd9cfe722d tempest-VolumeDependencyTests-208774870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:44 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0.info Sep 01 08:34:44 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:44 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3e821f81-bbfc-43c7-b619-79bc07e845c7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-98eee67d-ccf7-41e4-9bff-ebce238f7c1e" returned: 0 in 0.244s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3e821f81-bbfc-43c7-b619-79bc07e845c7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "cinder-quobyte-98eee67d-ccf7-41e4-9bff-ebce238f7c1e" released by "delete_volume" :: held 0.655s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-3e821f81-bbfc-43c7-b619-79bc07e845c7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Created reservations ['5f9540d9-9748-4914-ac1f-98ade4b07e3d', '2bc057d1-7825-489a-8984-e7af817f8e4f', 'd023d87c-2043-4968-974a-74be670f8ee5', 'fc9ff573-af65-4453-827c-41f5ececab1e'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:34:44 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-69a1ff70-44aa-4096-8eb8-67bd9cfe722d tempest-VolumeDependencyTests-208774870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0.info" returned: 0 in 0.255s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-69a1ff70-44aa-4096-8eb8-67bd9cfe722d tempest-VolumeDependencyTests-208774870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.955s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.884s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1116217166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e82c356a-638b-4154-a836-6b4aa59364ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef3d7e19a16458a94ec8926ac2849da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:41Z,use_quota=True,user_id='999b77df2aa046688e87487a73e33751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] Creating volume e82c356a-638b-4154-a836-6b4aa59364ba {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:34:44 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e82c356a-638b-4154-a836-6b4aa59364ba 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:44 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e82c356a-638b-4154-a836-6b4aa59364ba 1073741824 Sep 01 08:34:44 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:44 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-69a1ff70-44aa-4096-8eb8-67bd9cfe722d tempest-VolumeDependencyTests-208774870 None] Create snapshot completed successfully Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3e821f81-bbfc-43c7-b619-79bc07e845c7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3e821f81-bbfc-43c7-b619-79bc07e845c7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3e821f81-bbfc-43c7-b619-79bc07e845c7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3e821f81-bbfc-43c7-b619-79bc07e845c7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3e821f81-bbfc-43c7-b619-79bc07e845c7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3e821f81-bbfc-43c7-b619-79bc07e845c7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:44 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:34:44 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:44 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3e821f81-bbfc-43c7-b619-79bc07e845c7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.263s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-3e821f81-bbfc-43c7-b619-79bc07e845c7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b1da5e7a-c7e5-40f6-8917-a333bf46d262 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "cinder-a6dfcc33-7dcb-43a9-8784-2241de34506c-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:44 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-3e821f81-bbfc-43c7-b619-79bc07e845c7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Deleted volume successfully. Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b1da5e7a-c7e5-40f6-8917-a333bf46d262 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "cinder-a6dfcc33-7dcb-43a9-8784-2241de34506c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3e821f81-bbfc-43c7-b619-79bc07e845c7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "cinder-98eee67d-ccf7-41e4-9bff-ebce238f7c1e-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b1da5e7a-c7e5-40f6-8917-a333bf46d262 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "cinder-quobyte-a6dfcc33-7dcb-43a9-8784-2241de34506c" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:44 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b1da5e7a-c7e5-40f6-8917-a333bf46d262 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "cinder-quobyte-a6dfcc33-7dcb-43a9-8784-2241de34506c" acquired by "delete_volume" :: waited 0.017s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[8050e6e7-b606-4c88-93cd-74cf3ee98c13]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b1da5e7a-c7e5-40f6-8917-a333bf46d262 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a6dfcc33-7dcb-43a9-8784-2241de34506c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:45 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e82c356a-638b-4154-a836-6b4aa59364ba 1073741824" returned: 0 in 0.513s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e82c356a-638b-4154-a836-6b4aa59364ba {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:45 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e82c356a-638b-4154-a836-6b4aa59364ba Sep 01 08:34:45 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:45 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a6dfcc33-7dcb-43a9-8784-2241de34506c Sep 01 08:34:45 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:45 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e82c356a-638b-4154-a836-6b4aa59364ba" returned: 0 in 0.270s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-964940ba-4031-4d8f-a7ac-ab1b73561de1 tempest-CinderUnicodeTest-452759633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.658s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:45 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-964940ba-4031-4d8f-a7ac-ab1b73561de1 tempest-CinderUnicodeTest-452759633 None] Creating offline snapshot 55b8dc3d-3632-4b83-9595-b269f9c0cff2 of volume f05061ce-348e-4ae3-9764-334b777aed3b {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68fce71e-b219-454b-867e-6b23a3818b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e82c356a-638b-4154-a836-6b4aa59364ba', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be443ce-956f-44cc-87f2-7c9f18d566ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b1da5e7a-c7e5-40f6-8917-a333bf46d262 tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a6dfcc33-7dcb-43a9-8784-2241de34506c" returned: 0 in 0.458s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8d95b8-d650-4a70-9dd5-ddba126be529]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b1da5e7a-c7e5-40f6-8917-a333bf46d262 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a6dfcc33-7dcb-43a9-8784-2241de34506c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-964940ba-4031-4d8f-a7ac-ab1b73561de1 tempest-CinderUnicodeTest-452759633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:45 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a6dfcc33-7dcb-43a9-8784-2241de34506c Sep 01 08:34:45 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Flow 'volume_create_manager' (fbf532ae-042b-489a-83b0-bf8958783e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3769670a-9124-4810-823e-46170383d321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:45 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] Volume volume-e82c356a-638b-4154-a836-6b4aa59364ba (e82c356a-638b-4154-a836-6b4aa59364ba): created successfully Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be443ce-956f-44cc-87f2-7c9f18d566ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] Flow 'volume_create_manager' (24bbc9b9-8f73-47d7-ae47-2ea232298063) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3769670a-9124-4810-823e-46170383d321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2058531872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be07c2b-afee-48df-9b0b-f0291442e0cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33e10d4a13ef4407be476c78bb8d5176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4ad25cc3-7485-4a49-94e2-ed9871ab3f96,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:45Z,use_quota=True,user_id='60ea225abafc4c928cf59c37cadf18a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad0e0de8-c49b-4a94-95f7-b0d548bf9063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad0e0de8-c49b-4a94-95f7-b0d548bf9063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b77e4a89-e5ef-45dd-81a7-9cb22d677122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b77e4a89-e5ef-45dd-81a7-9cb22d677122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7be07c2b-afee-48df-9b0b-f0291442e0cc', 'volume_name': 'volume-7be07c2b-afee-48df-9b0b-f0291442e0cc', 'volume_size': 1, 'snapshot_id': '4ad25cc3-7485-4a49-94e2-ed9871ab3f96'}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f0634da-135c-407a-8d88-af38842e36bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f0634da-135c-407a-8d88-af38842e36bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20bdf3ee-a219-4cda-80cc-7b006a10971b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:45 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Volume 7be07c2b-afee-48df-9b0b-f0291442e0cc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7be07c2b-afee-48df-9b0b-f0291442e0cc', 'volume_size': 1, 'snapshot_id': '4ad25cc3-7485-4a49-94e2-ed9871ab3f96'} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:45 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-36e695ad-879b-4e1f-bdf1-c63459ea6da7 tempest-ProjectReaderTests-2124680279 None] Created volume successfully. Sep 01 08:34:45 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b Sep 01 08:34:45 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:45 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b1da5e7a-c7e5-40f6-8917-a333bf46d262 tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a6dfcc33-7dcb-43a9-8784-2241de34506c" returned: 0 in 0.293s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b1da5e7a-c7e5-40f6-8917-a333bf46d262 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "cinder-quobyte-a6dfcc33-7dcb-43a9-8784-2241de34506c" released by "delete_volume" :: held 0.815s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-b1da5e7a-c7e5-40f6-8917-a333bf46d262 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Created reservations ['68178a5d-a3b0-4854-b2d8-17bf89135847', 'cb95c84c-f8f3-48be-bea5-744ded827558', '0ce4a9b5-618b-4b53-8c50-ea727fd8c866', '37fed095-745b-4da7-b64a-174211a1d670'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:34:45 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-964940ba-4031-4d8f-a7ac-ab1b73561de1 tempest-CinderUnicodeTest-452759633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b" returned: 0 in 0.429s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-964940ba-4031-4d8f-a7ac-ab1b73561de1 tempest-CinderUnicodeTest-452759633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b.55b8dc3d-3632-4b83-9595-b269f9c0cff2 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9aa32812-e62e-4dff-8f43-c88dd9427f5f tempest-ProjectReaderTests-2124680279 None] Acquiring lock "cinder-e82c356a-638b-4154-a836-6b4aa59364ba-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b1da5e7a-c7e5-40f6-8917-a333bf46d262 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:45 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b.55b8dc3d-3632-4b83-9595-b269f9c0cff2 1G Sep 01 08:34:45 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b1da5e7a-c7e5-40f6-8917-a333bf46d262 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b1da5e7a-c7e5-40f6-8917-a333bf46d262 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b1da5e7a-c7e5-40f6-8917-a333bf46d262 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b1da5e7a-c7e5-40f6-8917-a333bf46d262 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b1da5e7a-c7e5-40f6-8917-a333bf46d262 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:46 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9aa32812-e62e-4dff-8f43-c88dd9427f5f tempest-ProjectReaderTests-2124680279 None] Lock "cinder-e82c356a-638b-4154-a836-6b4aa59364ba-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:46 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:34:46 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:46 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9aa32812-e62e-4dff-8f43-c88dd9427f5f tempest-ProjectReaderTests-2124680279 None] Acquiring lock "cinder-quobyte-e82c356a-638b-4154-a836-6b4aa59364ba" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:46 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9aa32812-e62e-4dff-8f43-c88dd9427f5f tempest-ProjectReaderTests-2124680279 None] Lock "cinder-quobyte-e82c356a-638b-4154-a836-6b4aa59364ba" acquired by "delete_volume" :: waited 0.022s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:46 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-71c44ed1-9dcd-49ec-8395-a95f82a4e5b3 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "cinder-ca0ab1ba-75f4-43ba-b999-3a6e1a79092a-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:46 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b8029a-afe1-48e3-8e3d-ccddec2e9d00]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9aa32812-e62e-4dff-8f43-c88dd9427f5f tempest-ProjectReaderTests-2124680279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e82c356a-638b-4154-a836-6b4aa59364ba {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:46 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-71c44ed1-9dcd-49ec-8395-a95f82a4e5b3 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "cinder-ca0ab1ba-75f4-43ba-b999-3a6e1a79092a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:46 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-71c44ed1-9dcd-49ec-8395-a95f82a4e5b3 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "cinder-quobyte-ca0ab1ba-75f4-43ba-b999-3a6e1a79092a" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:46 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-71c44ed1-9dcd-49ec-8395-a95f82a4e5b3 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "cinder-quobyte-ca0ab1ba-75f4-43ba-b999-3a6e1a79092a" acquired by "delete_volume" :: waited 0.022s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:46 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcbc3af-b210-493d-abf8-12f322dadfc6]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-71c44ed1-9dcd-49ec-8395-a95f82a4e5b3 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ca0ab1ba-75f4-43ba-b999-3a6e1a79092a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:46 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:46 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e82c356a-638b-4154-a836-6b4aa59364ba Sep 01 08:34:46 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b1da5e7a-c7e5-40f6-8917-a333bf46d262 tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.328s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:46 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-b1da5e7a-c7e5-40f6-8917-a333bf46d262 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:34:46 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-b1da5e7a-c7e5-40f6-8917-a333bf46d262 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Deleted volume successfully. Sep 01 08:34:46 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b1da5e7a-c7e5-40f6-8917-a333bf46d262 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "cinder-a6dfcc33-7dcb-43a9-8784-2241de34506c-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:46 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ca0ab1ba-75f4-43ba-b999-3a6e1a79092a Sep 01 08:34:46 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:46 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-964940ba-4031-4d8f-a7ac-ab1b73561de1 tempest-CinderUnicodeTest-452759633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b.55b8dc3d-3632-4b83-9595-b269f9c0cff2 1G" returned: 0 in 0.494s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-964940ba-4031-4d8f-a7ac-ab1b73561de1 tempest-CinderUnicodeTest-452759633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f05061ce-348e-4ae3-9764-334b777aed3b -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b.55b8dc3d-3632-4b83-9595-b269f9c0cff2 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:46 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f05061ce-348e-4ae3-9764-334b777aed3b -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b.55b8dc3d-3632-4b83-9595-b269f9c0cff2 Sep 01 08:34:46 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:46 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9aa32812-e62e-4dff-8f43-c88dd9427f5f tempest-ProjectReaderTests-2124680279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e82c356a-638b-4154-a836-6b4aa59364ba" returned: 0 in 0.438s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9aa32812-e62e-4dff-8f43-c88dd9427f5f tempest-ProjectReaderTests-2124680279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e82c356a-638b-4154-a836-6b4aa59364ba {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:46 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e82c356a-638b-4154-a836-6b4aa59364ba Sep 01 08:34:46 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:46 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-71c44ed1-9dcd-49ec-8395-a95f82a4e5b3 tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ca0ab1ba-75f4-43ba-b999-3a6e1a79092a" returned: 0 in 0.392s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-71c44ed1-9dcd-49ec-8395-a95f82a4e5b3 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ca0ab1ba-75f4-43ba-b999-3a6e1a79092a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:46 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ca0ab1ba-75f4-43ba-b999-3a6e1a79092a Sep 01 08:34:46 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:46 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-964940ba-4031-4d8f-a7ac-ab1b73561de1 tempest-CinderUnicodeTest-452759633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f05061ce-348e-4ae3-9764-334b777aed3b -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b.55b8dc3d-3632-4b83-9595-b269f9c0cff2" returned: 0 in 0.332s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:46 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-964940ba-4031-4d8f-a7ac-ab1b73561de1 tempest-CinderUnicodeTest-452759633 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b.55b8dc3d-3632-4b83-9595-b269f9c0cff2 is being set with open permissions: ugo+rw Sep 01 08:34:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-964940ba-4031-4d8f-a7ac-ab1b73561de1 tempest-CinderUnicodeTest-452759633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b.55b8dc3d-3632-4b83-9595-b269f9c0cff2 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:46 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b.55b8dc3d-3632-4b83-9595-b269f9c0cff2 Sep 01 08:34:46 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:46 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9aa32812-e62e-4dff-8f43-c88dd9427f5f tempest-ProjectReaderTests-2124680279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e82c356a-638b-4154-a836-6b4aa59364ba" returned: 0 in 0.289s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:46 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9aa32812-e62e-4dff-8f43-c88dd9427f5f tempest-ProjectReaderTests-2124680279 None] Lock "cinder-quobyte-e82c356a-638b-4154-a836-6b4aa59364ba" released by "delete_volume" :: held 0.789s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:46 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-9aa32812-e62e-4dff-8f43-c88dd9427f5f tempest-ProjectReaderTests-2124680279 None] Created reservations ['a5bd5373-3803-480e-98d5-bf817d568f8c', '0ed67fea-9c3c-43fc-9360-261dd5470bb3', '365dd4df-1891-43e3-a9e9-1d1aa31fdc4c', '02e8e826-6dfb-4892-965e-fa63a04a573a'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:34:46 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-71c44ed1-9dcd-49ec-8395-a95f82a4e5b3 tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ca0ab1ba-75f4-43ba-b999-3a6e1a79092a" returned: 0 in 0.269s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:46 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-71c44ed1-9dcd-49ec-8395-a95f82a4e5b3 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "cinder-quobyte-ca0ab1ba-75f4-43ba-b999-3a6e1a79092a" released by "delete_volume" :: held 0.715s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:47 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9aa32812-e62e-4dff-8f43-c88dd9427f5f tempest-ProjectReaderTests-2124680279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9aa32812-e62e-4dff-8f43-c88dd9427f5f tempest-ProjectReaderTests-2124680279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-9aa32812-e62e-4dff-8f43-c88dd9427f5f tempest-ProjectReaderTests-2124680279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-9aa32812-e62e-4dff-8f43-c88dd9427f5f tempest-ProjectReaderTests-2124680279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9aa32812-e62e-4dff-8f43-c88dd9427f5f tempest-ProjectReaderTests-2124680279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9aa32812-e62e-4dff-8f43-c88dd9427f5f tempest-ProjectReaderTests-2124680279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-964940ba-4031-4d8f-a7ac-ab1b73561de1 tempest-CinderUnicodeTest-452759633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b.55b8dc3d-3632-4b83-9595-b269f9c0cff2" returned: 0 in 0.288s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:47 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:34:47 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-71c44ed1-9dcd-49ec-8395-a95f82a4e5b3 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Created reservations ['ed001b7a-9bc0-422e-9d38-e04fc6ca2f2d', '07f4133b-371a-4fe8-bf71-ada15179f52f', '772a9121-6bc3-4b78-8cee-9dae637db717', 'e5449afc-1989-440f-a8b1-aa6d024ec3d7'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-964940ba-4031-4d8f-a7ac-ab1b73561de1 tempest-CinderUnicodeTest-452759633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:47 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b.info Sep 01 08:34:47 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-71c44ed1-9dcd-49ec-8395-a95f82a4e5b3 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-71c44ed1-9dcd-49ec-8395-a95f82a4e5b3 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-71c44ed1-9dcd-49ec-8395-a95f82a4e5b3 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-71c44ed1-9dcd-49ec-8395-a95f82a4e5b3 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-71c44ed1-9dcd-49ec-8395-a95f82a4e5b3 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-71c44ed1-9dcd-49ec-8395-a95f82a4e5b3 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:47 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:34:47 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:47 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9aa32812-e62e-4dff-8f43-c88dd9427f5f tempest-ProjectReaderTests-2124680279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.323s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-9aa32812-e62e-4dff-8f43-c88dd9427f5f tempest-ProjectReaderTests-2124680279 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:34:47 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-9aa32812-e62e-4dff-8f43-c88dd9427f5f tempest-ProjectReaderTests-2124680279 None] Deleted volume successfully. Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-c2057dc5-5e1d-4cda-b1f5-5e37d48f9f90 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "cinder-9ffafe1d-23f2-4818-a82b-7bc9a6ec8217-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-c2057dc5-5e1d-4cda-b1f5-5e37d48f9f90 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "cinder-9ffafe1d-23f2-4818-a82b-7bc9a6ec8217-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9aa32812-e62e-4dff-8f43-c88dd9427f5f tempest-ProjectReaderTests-2124680279 None] Lock "cinder-e82c356a-638b-4154-a836-6b4aa59364ba-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-c2057dc5-5e1d-4cda-b1f5-5e37d48f9f90 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "cinder-quobyte-9ffafe1d-23f2-4818-a82b-7bc9a6ec8217" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:47 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-964940ba-4031-4d8f-a7ac-ab1b73561de1 tempest-CinderUnicodeTest-452759633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b.info" returned: 0 in 0.413s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:47 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-964940ba-4031-4d8f-a7ac-ab1b73561de1 tempest-CinderUnicodeTest-452759633 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b.info is being set with open permissions: ugo+rw Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-964940ba-4031-4d8f-a7ac-ab1b73561de1 tempest-CinderUnicodeTest-452759633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-c2057dc5-5e1d-4cda-b1f5-5e37d48f9f90 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "cinder-quobyte-9ffafe1d-23f2-4818-a82b-7bc9a6ec8217" acquired by "delete_volume" :: waited 0.043s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:47 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b.info Sep 01 08:34:47 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bda5c0-27b9-4e5c-ba4a-a9525cfb09fa]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c2057dc5-5e1d-4cda-b1f5-5e37d48f9f90 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9ffafe1d-23f2-4818-a82b-7bc9a6ec8217 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:47 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-71c44ed1-9dcd-49ec-8395-a95f82a4e5b3 tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.416s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-71c44ed1-9dcd-49ec-8395-a95f82a4e5b3 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:34:47 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-71c44ed1-9dcd-49ec-8395-a95f82a4e5b3 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Deleted volume successfully. Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-71c44ed1-9dcd-49ec-8395-a95f82a4e5b3 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "cinder-ca0ab1ba-75f4-43ba-b999-3a6e1a79092a-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:47 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9ffafe1d-23f2-4818-a82b-7bc9a6ec8217 Sep 01 08:34:47 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:47 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] Flow 'volume_create_manager' (db881670-ce29-4a47-8ba5-5317c528c580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30af0eed-0881-428d-bf5a-323b15d4597f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-964940ba-4031-4d8f-a7ac-ab1b73561de1 tempest-CinderUnicodeTest-452759633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b.info" returned: 0 in 0.338s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-964940ba-4031-4d8f-a7ac-ab1b73561de1 tempest-CinderUnicodeTest-452759633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.486s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.237s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Acquiring lock "cinder-quobyte-4ad25cc3-7485-4a49-94e2-ed9871ab3f96-7be07c2b-afee-48df-9b0b-f0291442e0cc" by "_create_volume_from_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30af0eed-0881-428d-bf5a-323b15d4597f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-541518895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74103094-7c6f-47c2-86cd-de4dd8a91ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef3d7e19a16458a94ec8926ac2849da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:48Z,use_quota=True,user_id='999b77df2aa046688e87487a73e33751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eefb52c-d622-4ccf-ac7f-d877933a1ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eefb52c-d622-4ccf-ac7f-d877933a1ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e51bddb4-d9de-4c82-b60f-85247aa002df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e51bddb4-d9de-4c82-b60f-85247aa002df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74103094-7c6f-47c2-86cd-de4dd8a91ff7', 'volume_name': 'volume-74103094-7c6f-47c2-86cd-de4dd8a91ff7', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d4c3ed-34da-48ad-9777-9e1b771ac4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d4c3ed-34da-48ad-9777-9e1b771ac4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77654494-4992-4595-b195-74066794475c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:47 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] Volume 74103094-7c6f-47c2-86cd-de4dd8a91ff7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74103094-7c6f-47c2-86cd-de4dd8a91ff7', 'volume_size': 1} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Lock "cinder-quobyte-4ad25cc3-7485-4a49-94e2-ed9871ab3f96-7be07c2b-afee-48df-9b0b-f0291442e0cc" acquired by "_create_volume_from_snapshot" :: waited 0.065s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Creating volume 7be07c2b-afee-48df-9b0b-f0291442e0cc from snapshot 4ad25cc3-7485-4a49-94e2-ed9871ab3f96 {{(pid=86893) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Acquiring lock "cinder-quobyte-7be07c2b-afee-48df-9b0b-f0291442e0cc" by "_copy_volume_from_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:47 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-964940ba-4031-4d8f-a7ac-ab1b73561de1 tempest-CinderUnicodeTest-452759633 None] Create snapshot completed successfully Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Lock "cinder-quobyte-7be07c2b-afee-48df-9b0b-f0291442e0cc" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] snapshot: 4ad25cc3-7485-4a49-94e2-ed9871ab3f96, volume: 7be07c2b-afee-48df-9b0b-f0291442e0cc, {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac64bb9-cae8-4da9-9fde-52d9692273ef]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0.4ad25cc3-7485-4a49-94e2-ed9871ab3f96 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:48 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c2057dc5-5e1d-4cda-b1f5-5e37d48f9f90 tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9ffafe1d-23f2-4818-a82b-7bc9a6ec8217" returned: 0 in 0.449s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c2057dc5-5e1d-4cda-b1f5-5e37d48f9f90 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9ffafe1d-23f2-4818-a82b-7bc9a6ec8217 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:48 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9ffafe1d-23f2-4818-a82b-7bc9a6ec8217 Sep 01 08:34:48 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:48 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0.4ad25cc3-7485-4a49-94e2-ed9871ab3f96 Sep 01 08:34:48 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:48 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c2057dc5-5e1d-4cda-b1f5-5e37d48f9f90 tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-9ffafe1d-23f2-4818-a82b-7bc9a6ec8217" returned: 0 in 0.264s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-c2057dc5-5e1d-4cda-b1f5-5e37d48f9f90 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "cinder-quobyte-9ffafe1d-23f2-4818-a82b-7bc9a6ec8217" released by "delete_volume" :: held 0.778s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-c2057dc5-5e1d-4cda-b1f5-5e37d48f9f90 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Created reservations ['4830d851-8df1-475c-a679-bf3d89ed1091', '56bd38fc-157d-4a7e-b040-5997c367ecf4', 'def43018-ed84-4c6f-a6e3-1fc77b46748c', '8c81bf47-147f-45d4-bae7-093bec15c96c'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:34:48 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0.4ad25cc3-7485-4a49-94e2-ed9871ab3f96" returned: 0 in 0.395s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16a108aa-3f12-41a4-952a-bec9928f2ac0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[327416ef-5d95-4e12-938b-0e002ab6eda3]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c2057dc5-5e1d-4cda-b1f5-5e37d48f9f90 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c2057dc5-5e1d-4cda-b1f5-5e37d48f9f90 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c2057dc5-5e1d-4cda-b1f5-5e37d48f9f90 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c2057dc5-5e1d-4cda-b1f5-5e37d48f9f90 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c2057dc5-5e1d-4cda-b1f5-5e37d48f9f90 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c2057dc5-5e1d-4cda-b1f5-5e37d48f9f90 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:48 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:34:48 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:48 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0 Sep 01 08:34:48 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-806eec4d-627c-46c6-a9a2-1a1cc67f678d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "cinder-88017f89-7bdc-4176-926b-790ea56548f3-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-806eec4d-627c-46c6-a9a2-1a1cc67f678d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "cinder-88017f89-7bdc-4176-926b-790ea56548f3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-806eec4d-627c-46c6-a9a2-1a1cc67f678d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "cinder-quobyte-88017f89-7bdc-4176-926b-790ea56548f3" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:48 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c2057dc5-5e1d-4cda-b1f5-5e37d48f9f90 tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.283s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-c2057dc5-5e1d-4cda-b1f5-5e37d48f9f90 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-806eec4d-627c-46c6-a9a2-1a1cc67f678d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "cinder-quobyte-88017f89-7bdc-4176-926b-790ea56548f3" acquired by "delete_volume" :: waited 0.024s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:48 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-c2057dc5-5e1d-4cda-b1f5-5e37d48f9f90 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Deleted volume successfully. Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f30776-de3b-47af-aa08-f0ec9d2f14ca]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-806eec4d-627c-46c6-a9a2-1a1cc67f678d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-88017f89-7bdc-4176-926b-790ea56548f3 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-c2057dc5-5e1d-4cda-b1f5-5e37d48f9f90 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "cinder-9ffafe1d-23f2-4818-a82b-7bc9a6ec8217-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:48 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0" returned: 0 in 0.436s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0 {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Creating direct copy from snapshot {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG cinder.utils [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Path /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7be07c2b-afee-48df-9b0b-f0291442e0cc not found in is_blk_device check {{(pid=86893) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 08:34:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7be07c2b-afee-48df-9b0b-f0291442e0cc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:48 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-88017f89-7bdc-4176-926b-790ea56548f3 Sep 01 08:34:48 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:48 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7be07c2b-afee-48df-9b0b-f0291442e0cc Sep 01 08:34:48 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:49 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-26d644e6-afc0-4f35-abfb-8a51e276db09 tempest-CinderUnicodeTest-452759633 None] Acquiring lock "cinder-55b8dc3d-3632-4b83-9595-b269f9c0cff2-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:49 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-26d644e6-afc0-4f35-abfb-8a51e276db09 tempest-CinderUnicodeTest-452759633 None] Lock "cinder-55b8dc3d-3632-4b83-9595-b269f9c0cff2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:49 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-26d644e6-afc0-4f35-abfb-8a51e276db09 tempest-CinderUnicodeTest-452759633 None] Acquiring lock "cinder-quobyte-f05061ce-348e-4ae3-9764-334b777aed3b" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:49 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-26d644e6-afc0-4f35-abfb-8a51e276db09 tempest-CinderUnicodeTest-452759633 None] Lock "cinder-quobyte-f05061ce-348e-4ae3-9764-334b777aed3b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:49 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-26d644e6-afc0-4f35-abfb-8a51e276db09 tempest-CinderUnicodeTest-452759633 None] Acquiring lock "cinder-quobyte-55b8dc3d-3632-4b83-9595-b269f9c0cff2" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:49 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-26d644e6-afc0-4f35-abfb-8a51e276db09 tempest-CinderUnicodeTest-452759633 None] Lock "cinder-quobyte-55b8dc3d-3632-4b83-9595-b269f9c0cff2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:49 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-26d644e6-afc0-4f35-abfb-8a51e276db09 tempest-CinderUnicodeTest-452759633 None] Deleting offline snapshot 55b8dc3d-3632-4b83-9595-b269f9c0cff2 of volume f05061ce-348e-4ae3-9764-334b777aed3b {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:34:49 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-26d644e6-afc0-4f35-abfb-8a51e276db09 tempest-CinderUnicodeTest-452759633 None] snapshot_file for this snap is: volume-f05061ce-348e-4ae3-9764-334b777aed3b.55b8dc3d-3632-4b83-9595-b269f9c0cff2 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:34:49 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38f523a-77f3-47e9-b428-fcdce0718ef7]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-26d644e6-afc0-4f35-abfb-8a51e276db09 tempest-CinderUnicodeTest-452759633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b.55b8dc3d-3632-4b83-9595-b269f9c0cff2 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:49 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-806eec4d-627c-46c6-a9a2-1a1cc67f678d tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-88017f89-7bdc-4176-926b-790ea56548f3" returned: 0 in 0.418s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-806eec4d-627c-46c6-a9a2-1a1cc67f678d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-88017f89-7bdc-4176-926b-790ea56548f3 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:49 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-88017f89-7bdc-4176-926b-790ea56548f3 Sep 01 08:34:49 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:49 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b.55b8dc3d-3632-4b83-9595-b269f9c0cff2 Sep 01 08:34:49 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:49 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-26d644e6-afc0-4f35-abfb-8a51e276db09 tempest-CinderUnicodeTest-452759633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b.55b8dc3d-3632-4b83-9595-b269f9c0cff2" returned: 0 in 0.598s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:49 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-26d644e6-afc0-4f35-abfb-8a51e276db09 tempest-CinderUnicodeTest-452759633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f05061ce-348e-4ae3-9764-334b777aed3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:34:49 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c1e804-e9af-4315-aa1c-ff446ec4db63]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-26d644e6-afc0-4f35-abfb-8a51e276db09 tempest-CinderUnicodeTest-452759633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:49 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-806eec4d-627c-46c6-a9a2-1a1cc67f678d tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-88017f89-7bdc-4176-926b-790ea56548f3" returned: 0 in 0.745s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:49 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-806eec4d-627c-46c6-a9a2-1a1cc67f678d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "cinder-quobyte-88017f89-7bdc-4176-926b-790ea56548f3" released by "delete_volume" :: held 1.242s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:50 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b Sep 01 08:34:50 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:50 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-806eec4d-627c-46c6-a9a2-1a1cc67f678d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Created reservations ['15f9dd07-5c83-4af9-b65b-f094d84fb65a', '61143cc0-05b0-412d-be69-42bb7a03fe43', 'a7d5204e-5f13-4460-86d5-b1ed07e179e8', 'db12cc50-c54d-4427-974d-8e42ec1e03a3'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:34:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-806eec4d-627c-46c6-a9a2-1a1cc67f678d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-806eec4d-627c-46c6-a9a2-1a1cc67f678d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:50 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-806eec4d-627c-46c6-a9a2-1a1cc67f678d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:50 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-806eec4d-627c-46c6-a9a2-1a1cc67f678d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-806eec4d-627c-46c6-a9a2-1a1cc67f678d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-806eec4d-627c-46c6-a9a2-1a1cc67f678d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:50 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:34:50 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:50 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-26d644e6-afc0-4f35-abfb-8a51e276db09 tempest-CinderUnicodeTest-452759633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b" returned: 0 in 0.811s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-26d644e6-afc0-4f35-abfb-8a51e276db09 tempest-CinderUnicodeTest-452759633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b.55b8dc3d-3632-4b83-9595-b269f9c0cff2 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:50 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b.55b8dc3d-3632-4b83-9595-b269f9c0cff2 Sep 01 08:34:50 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:51 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-806eec4d-627c-46c6-a9a2-1a1cc67f678d tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.516s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:51 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-806eec4d-627c-46c6-a9a2-1a1cc67f678d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:34:51 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-806eec4d-627c-46c6-a9a2-1a1cc67f678d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Deleted volume successfully. Sep 01 08:34:51 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-806eec4d-627c-46c6-a9a2-1a1cc67f678d tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "cinder-88017f89-7bdc-4176-926b-790ea56548f3-delete_volume" released by "delete_volume" :: held 2.477s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:51 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1057b873-11a4-441e-944c-31e0ffcc8de7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "cinder-9d51cceb-0d03-45fe-8b84-670258e16e65-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:51 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1057b873-11a4-441e-944c-31e0ffcc8de7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "cinder-9d51cceb-0d03-45fe-8b84-670258e16e65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:51 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1057b873-11a4-441e-944c-31e0ffcc8de7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "cinder-quobyte-64920481-9779-455e-8406-e32a3e1ead7e" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:51 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1057b873-11a4-441e-944c-31e0ffcc8de7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "cinder-quobyte-64920481-9779-455e-8406-e32a3e1ead7e" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:51 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1057b873-11a4-441e-944c-31e0ffcc8de7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "cinder-quobyte-9d51cceb-0d03-45fe-8b84-670258e16e65" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:51 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1057b873-11a4-441e-944c-31e0ffcc8de7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "cinder-quobyte-9d51cceb-0d03-45fe-8b84-670258e16e65" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:51 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-1057b873-11a4-441e-944c-31e0ffcc8de7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Deleting offline snapshot 9d51cceb-0d03-45fe-8b84-670258e16e65 of volume 64920481-9779-455e-8406-e32a3e1ead7e {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:34:51 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-1057b873-11a4-441e-944c-31e0ffcc8de7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] snapshot_file for this snap is: volume-64920481-9779-455e-8406-e32a3e1ead7e.9d51cceb-0d03-45fe-8b84-670258e16e65 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:34:51 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fde1083-3ca5-4526-bf20-6c6caad7be02]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1057b873-11a4-441e-944c-31e0ffcc8de7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e.9d51cceb-0d03-45fe-8b84-670258e16e65 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:51 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e.9d51cceb-0d03-45fe-8b84-670258e16e65 Sep 01 08:34:51 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:51 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-26d644e6-afc0-4f35-abfb-8a51e276db09 tempest-CinderUnicodeTest-452759633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b.55b8dc3d-3632-4b83-9595-b269f9c0cff2" returned: 0 in 1.152s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-26d644e6-afc0-4f35-abfb-8a51e276db09 tempest-CinderUnicodeTest-452759633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b.55b8dc3d-3632-4b83-9595-b269f9c0cff2 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:51 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b.55b8dc3d-3632-4b83-9595-b269f9c0cff2 Sep 01 08:34:51 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:52 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1057b873-11a4-441e-944c-31e0ffcc8de7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e.9d51cceb-0d03-45fe-8b84-670258e16e65" returned: 0 in 0.839s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-1057b873-11a4-441e-944c-31e0ffcc8de7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64920481-9779-455e-8406-e32a3e1ead7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:34:52 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[e230004d-94e6-4027-b8d2-512ef080a5b3]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1057b873-11a4-441e-944c-31e0ffcc8de7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:52 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-26d644e6-afc0-4f35-abfb-8a51e276db09 tempest-CinderUnicodeTest-452759633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b.55b8dc3d-3632-4b83-9595-b269f9c0cff2" returned: 0 in 0.659s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:52 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e Sep 01 08:34:52 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:52 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-26d644e6-afc0-4f35-abfb-8a51e276db09 tempest-CinderUnicodeTest-452759633 None] Lock "cinder-quobyte-55b8dc3d-3632-4b83-9595-b269f9c0cff2" released by "_delete_snapshot" :: held 3.513s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:52 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-26d644e6-afc0-4f35-abfb-8a51e276db09 tempest-CinderUnicodeTest-452759633 None] Lock "cinder-quobyte-f05061ce-348e-4ae3-9764-334b777aed3b" released by "delete_snapshot" :: held 3.550s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:52 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-26d644e6-afc0-4f35-abfb-8a51e276db09 tempest-CinderUnicodeTest-452759633 None] Created reservations ['93d5b766-7e76-4128-bb43-7040c3dc6555', '3ac9e24c-2538-4730-a596-552d51b21908', 'fcbeedbb-0840-408f-85ed-f382df4ef425', 'c5d61bab-4aa5-4087-b64a-69acf7b4245b'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:34:52 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-26d644e6-afc0-4f35-abfb-8a51e276db09 tempest-CinderUnicodeTest-452759633 None] Delete snapshot completed successfully. Sep 01 08:34:52 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-26d644e6-afc0-4f35-abfb-8a51e276db09 tempest-CinderUnicodeTest-452759633 None] Lock "cinder-55b8dc3d-3632-4b83-9595-b269f9c0cff2-delete_snapshot" released by "delete_snapshot" :: held 3.943s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:53 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1057b873-11a4-441e-944c-31e0ffcc8de7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e" returned: 0 in 0.697s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1057b873-11a4-441e-944c-31e0ffcc8de7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e.9d51cceb-0d03-45fe-8b84-670258e16e65 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:53 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e.9d51cceb-0d03-45fe-8b84-670258e16e65 Sep 01 08:34:53 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:53 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-56a151c7-7c38-42ff-b357-ffdfd03ee67f tempest-CinderUnicodeTest-452759633 None] Acquiring lock "cinder-f05061ce-348e-4ae3-9764-334b777aed3b-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:53 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-56a151c7-7c38-42ff-b357-ffdfd03ee67f tempest-CinderUnicodeTest-452759633 None] Lock "cinder-f05061ce-348e-4ae3-9764-334b777aed3b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:53 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-56a151c7-7c38-42ff-b357-ffdfd03ee67f tempest-CinderUnicodeTest-452759633 None] Acquiring lock "cinder-quobyte-f05061ce-348e-4ae3-9764-334b777aed3b" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:53 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1057b873-11a4-441e-944c-31e0ffcc8de7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e.9d51cceb-0d03-45fe-8b84-670258e16e65" returned: 0 in 0.683s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1057b873-11a4-441e-944c-31e0ffcc8de7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e.9d51cceb-0d03-45fe-8b84-670258e16e65 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:53 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-56a151c7-7c38-42ff-b357-ffdfd03ee67f tempest-CinderUnicodeTest-452759633 None] Lock "cinder-quobyte-f05061ce-348e-4ae3-9764-334b777aed3b" acquired by "delete_volume" :: waited 0.081s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:53 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e.9d51cceb-0d03-45fe-8b84-670258e16e65 Sep 01 08:34:53 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:53 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[939ac0bf-64fc-43cd-bbfb-276d77f71516]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-56a151c7-7c38-42ff-b357-ffdfd03ee67f tempest-CinderUnicodeTest-452759633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:54 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b Sep 01 08:34:54 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:54 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7be07c2b-afee-48df-9b0b-f0291442e0cc" returned: 0 in 5.382s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:54 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Image conversion details: src /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0, size 1024.00 MB, duration 5.38 sec, destination /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7be07c2b-afee-48df-9b0b-f0291442e0cc {{(pid=86893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 08:34:54 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Converted 1024.00 MB image at 190.21 MB/s Sep 01 08:34:54 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7be07c2b-afee-48df-9b0b-f0291442e0cc is being set with open permissions: ugo+rw Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7be07c2b-afee-48df-9b0b-f0291442e0cc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1057b873-11a4-441e-944c-31e0ffcc8de7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e.9d51cceb-0d03-45fe-8b84-670258e16e65" returned: 0 in 0.511s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:54 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7be07c2b-afee-48df-9b0b-f0291442e0cc Sep 01 08:34:54 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1057b873-11a4-441e-944c-31e0ffcc8de7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "cinder-quobyte-9d51cceb-0d03-45fe-8b84-670258e16e65" released by "_delete_snapshot" :: held 2.973s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1057b873-11a4-441e-944c-31e0ffcc8de7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "cinder-quobyte-64920481-9779-455e-8406-e32a3e1ead7e" released by "delete_snapshot" :: held 3.044s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-1057b873-11a4-441e-944c-31e0ffcc8de7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Created reservations ['083fd728-3921-4e44-876c-a4b34fc572c7', '1fdbc464-545d-4de0-ac77-da174e537ca5', '48478639-ef02-4e8d-a11d-baf7342b58f5', '2325ba60-92f9-4ba1-aa3d-a911d0651cef'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:34:54 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-56a151c7-7c38-42ff-b357-ffdfd03ee67f tempest-CinderUnicodeTest-452759633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b" returned: 0 in 0.626s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-56a151c7-7c38-42ff-b357-ffdfd03ee67f tempest-CinderUnicodeTest-452759633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:54 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b Sep 01 08:34:54 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:54 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-1057b873-11a4-441e-944c-31e0ffcc8de7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Delete snapshot completed successfully. Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1057b873-11a4-441e-944c-31e0ffcc8de7 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "cinder-9d51cceb-0d03-45fe-8b84-670258e16e65-delete_snapshot" released by "delete_snapshot" :: held 3.313s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:54 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7be07c2b-afee-48df-9b0b-f0291442e0cc" returned: 0 in 0.354s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Lock "cinder-quobyte-7be07c2b-afee-48df-9b0b-f0291442e0cc" released by "_copy_volume_from_snapshot" :: held 6.655s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Lock "cinder-quobyte-4ad25cc3-7485-4a49-94e2-ed9871ab3f96-7be07c2b-afee-48df-9b0b-f0291442e0cc" released by "_create_volume_from_snapshot" :: held 6.721s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.788s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.732s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-541518895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74103094-7c6f-47c2-86cd-de4dd8a91ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef3d7e19a16458a94ec8926ac2849da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:34:48Z,use_quota=True,user_id='999b77df2aa046688e87487a73e33751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] Creating volume 74103094-7c6f-47c2-86cd-de4dd8a91ff7 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:34:54 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-74103094-7c6f-47c2-86cd-de4dd8a91ff7 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:54 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-74103094-7c6f-47c2-86cd-de4dd8a91ff7 1073741824 Sep 01 08:34:54 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20bdf3ee-a219-4cda-80cc-7b006a10971b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7be07c2b-afee-48df-9b0b-f0291442e0cc', 'volume_size': 1, 'snapshot_id': '4ad25cc3-7485-4a49-94e2-ed9871ab3f96'}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d6302a-6648-43b3-ad88-066f3b9d1791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:54 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Volume volume-7be07c2b-afee-48df-9b0b-f0291442e0cc (7be07c2b-afee-48df-9b0b-f0291442e0cc): created successfully Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d6302a-6648-43b3-ad88-066f3b9d1791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Flow 'volume_create_manager' (fbf532ae-042b-489a-83b0-bf8958783e75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:54 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-1018d485-a956-4ab4-8e18-2c6789b1b493 tempest-VolumeDependencyTests-208774870 None] Created volume successfully. Sep 01 08:34:54 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-56a151c7-7c38-42ff-b357-ffdfd03ee67f tempest-CinderUnicodeTest-452759633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-f05061ce-348e-4ae3-9764-334b777aed3b" returned: 0 in 0.268s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-56a151c7-7c38-42ff-b357-ffdfd03ee67f tempest-CinderUnicodeTest-452759633 None] Lock "cinder-quobyte-f05061ce-348e-4ae3-9764-334b777aed3b" released by "delete_volume" :: held 1.012s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-56a151c7-7c38-42ff-b357-ffdfd03ee67f tempest-CinderUnicodeTest-452759633 None] Created reservations ['58c5e6d8-13a7-4d46-b08f-8e8c26587dca', 'a572a008-5521-4ab6-ae45-ca049d76c5ca', '42c14bbc-0503-4d22-9bfc-f50ebedde004', '4b13d315-8dee-47bc-8157-befaea683d5f'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-56a151c7-7c38-42ff-b357-ffdfd03ee67f tempest-CinderUnicodeTest-452759633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-56a151c7-7c38-42ff-b357-ffdfd03ee67f tempest-CinderUnicodeTest-452759633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-56a151c7-7c38-42ff-b357-ffdfd03ee67f tempest-CinderUnicodeTest-452759633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-56a151c7-7c38-42ff-b357-ffdfd03ee67f tempest-CinderUnicodeTest-452759633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-56a151c7-7c38-42ff-b357-ffdfd03ee67f tempest-CinderUnicodeTest-452759633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-56a151c7-7c38-42ff-b357-ffdfd03ee67f tempest-CinderUnicodeTest-452759633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:54 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:34:54 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:55 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-74103094-7c6f-47c2-86cd-de4dd8a91ff7 1073741824" returned: 0 in 0.466s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:55 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-56a151c7-7c38-42ff-b357-ffdfd03ee67f tempest-CinderUnicodeTest-452759633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.261s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-56a151c7-7c38-42ff-b357-ffdfd03ee67f tempest-CinderUnicodeTest-452759633 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-74103094-7c6f-47c2-86cd-de4dd8a91ff7 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:55 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-56a151c7-7c38-42ff-b357-ffdfd03ee67f tempest-CinderUnicodeTest-452759633 None] Deleted volume successfully. Sep 01 08:34:55 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-74103094-7c6f-47c2-86cd-de4dd8a91ff7 Sep 01 08:34:55 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-56a151c7-7c38-42ff-b357-ffdfd03ee67f tempest-CinderUnicodeTest-452759633 None] Lock "cinder-f05061ce-348e-4ae3-9764-334b777aed3b-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6a5a8f43-3b56-4e1d-8ab3-fea52c56edf1 tempest-VolumeDependencyTests-208774870 None] Acquiring lock "cinder-4ad25cc3-7485-4a49-94e2-ed9871ab3f96-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:55 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-74103094-7c6f-47c2-86cd-de4dd8a91ff7" returned: 0 in 0.249s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6a5a8f43-3b56-4e1d-8ab3-fea52c56edf1 tempest-VolumeDependencyTests-208774870 None] Lock "cinder-4ad25cc3-7485-4a49-94e2-ed9871ab3f96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6a5a8f43-3b56-4e1d-8ab3-fea52c56edf1 tempest-VolumeDependencyTests-208774870 None] Acquiring lock "cinder-quobyte-16a108aa-3f12-41a4-952a-bec9928f2ac0" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77654494-4992-4595-b195-74066794475c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74103094-7c6f-47c2-86cd-de4dd8a91ff7', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (401b5508-a8b8-426e-8736-9d4bed139cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6a5a8f43-3b56-4e1d-8ab3-fea52c56edf1 tempest-VolumeDependencyTests-208774870 None] Lock "cinder-quobyte-16a108aa-3f12-41a4-952a-bec9928f2ac0" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6a5a8f43-3b56-4e1d-8ab3-fea52c56edf1 tempest-VolumeDependencyTests-208774870 None] Acquiring lock "cinder-quobyte-4ad25cc3-7485-4a49-94e2-ed9871ab3f96" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:55 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] Volume volume-74103094-7c6f-47c2-86cd-de4dd8a91ff7 (74103094-7c6f-47c2-86cd-de4dd8a91ff7): created successfully Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (401b5508-a8b8-426e-8736-9d4bed139cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] Flow 'volume_create_manager' (db881670-ce29-4a47-8ba5-5317c528c580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6a5a8f43-3b56-4e1d-8ab3-fea52c56edf1 tempest-VolumeDependencyTests-208774870 None] Lock "cinder-quobyte-4ad25cc3-7485-4a49-94e2-ed9871ab3f96" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-6a5a8f43-3b56-4e1d-8ab3-fea52c56edf1 tempest-VolumeDependencyTests-208774870 None] Deleting offline snapshot 4ad25cc3-7485-4a49-94e2-ed9871ab3f96 of volume 16a108aa-3f12-41a4-952a-bec9928f2ac0 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-6a5a8f43-3b56-4e1d-8ab3-fea52c56edf1 tempest-VolumeDependencyTests-208774870 None] snapshot_file for this snap is: volume-16a108aa-3f12-41a4-952a-bec9928f2ac0.4ad25cc3-7485-4a49-94e2-ed9871ab3f96 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:34:55 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-536531cb-918e-4b5f-91a1-a23551c5878e tempest-ProjectReaderTests-2124680279 None] Created volume successfully. Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae51f252-e51b-4594-a602-232fe269169f]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6a5a8f43-3b56-4e1d-8ab3-fea52c56edf1 tempest-VolumeDependencyTests-208774870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0.4ad25cc3-7485-4a49-94e2-ed9871ab3f96 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-12628333-87fe-4380-907e-b989d28a6397 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "cinder-64920481-9779-455e-8406-e32a3e1ead7e-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-12628333-87fe-4380-907e-b989d28a6397 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "cinder-64920481-9779-455e-8406-e32a3e1ead7e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-12628333-87fe-4380-907e-b989d28a6397 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "cinder-quobyte-64920481-9779-455e-8406-e32a3e1ead7e" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:55 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0.4ad25cc3-7485-4a49-94e2-ed9871ab3f96 Sep 01 08:34:55 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-12628333-87fe-4380-907e-b989d28a6397 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "cinder-quobyte-64920481-9779-455e-8406-e32a3e1ead7e" acquired by "delete_volume" :: waited 0.023s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8e63d2-b4ae-4d62-ad96-fec8735fb110]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-12628333-87fe-4380-907e-b989d28a6397 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:55 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e Sep 01 08:34:55 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9cc484b9-ecbc-4e7f-8236-966a78c9906e tempest-CinderUnicodeTest-452759633 None] Acquiring lock "cinder-4cc798f2-9b28-4db5-acdd-a887968c4169-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9cc484b9-ecbc-4e7f-8236-966a78c9906e tempest-CinderUnicodeTest-452759633 None] Lock "cinder-4cc798f2-9b28-4db5-acdd-a887968c4169-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:55 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6a5a8f43-3b56-4e1d-8ab3-fea52c56edf1 tempest-VolumeDependencyTests-208774870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0.4ad25cc3-7485-4a49-94e2-ed9871ab3f96" returned: 0 in 0.422s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-6a5a8f43-3b56-4e1d-8ab3-fea52c56edf1 tempest-VolumeDependencyTests-208774870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16a108aa-3f12-41a4-952a-bec9928f2ac0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9cc484b9-ecbc-4e7f-8236-966a78c9906e tempest-CinderUnicodeTest-452759633 None] Acquiring lock "cinder-quobyte-4cc798f2-9b28-4db5-acdd-a887968c4169" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[763dde31-893d-4d1a-a9a8-7c0321b5fc14]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6a5a8f43-3b56-4e1d-8ab3-fea52c56edf1 tempest-VolumeDependencyTests-208774870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9cc484b9-ecbc-4e7f-8236-966a78c9906e tempest-CinderUnicodeTest-452759633 None] Lock "cinder-quobyte-4cc798f2-9b28-4db5-acdd-a887968c4169" acquired by "delete_volume" :: waited 0.025s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:56 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedc994d-8601-4432-a772-bcd517efe3dc]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9cc484b9-ecbc-4e7f-8236-966a78c9906e tempest-CinderUnicodeTest-452759633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cc798f2-9b28-4db5-acdd-a887968c4169 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:56 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0 Sep 01 08:34:56 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:56 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:56 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cc798f2-9b28-4db5-acdd-a887968c4169 Sep 01 08:34:56 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-12628333-87fe-4380-907e-b989d28a6397 tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e" returned: 0 in 0.445s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-12628333-87fe-4380-907e-b989d28a6397 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:56 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e Sep 01 08:34:56 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:56 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9cc484b9-ecbc-4e7f-8236-966a78c9906e tempest-CinderUnicodeTest-452759633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cc798f2-9b28-4db5-acdd-a887968c4169" returned: 0 in 0.391s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9cc484b9-ecbc-4e7f-8236-966a78c9906e tempest-CinderUnicodeTest-452759633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cc798f2-9b28-4db5-acdd-a887968c4169 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:56 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-12628333-87fe-4380-907e-b989d28a6397 tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-64920481-9779-455e-8406-e32a3e1ead7e" returned: 0 in 0.280s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:56 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cc798f2-9b28-4db5-acdd-a887968c4169 Sep 01 08:34:56 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-12628333-87fe-4380-907e-b989d28a6397 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "cinder-quobyte-64920481-9779-455e-8406-e32a3e1ead7e" released by "delete_volume" :: held 0.790s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:56 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-12628333-87fe-4380-907e-b989d28a6397 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Created reservations ['5d7b966b-5516-485f-9460-0297f857020c', 'b9c5149f-a970-434f-b1b3-225ce0067995', '2b593b3a-e1e6-456d-b1ff-0caec64927c9', '9ae5d2b9-896d-4b1f-a403-56d62d1a662f'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:34:56 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6a5a8f43-3b56-4e1d-8ab3-fea52c56edf1 tempest-VolumeDependencyTests-208774870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0" returned: 0 in 0.631s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6a5a8f43-3b56-4e1d-8ab3-fea52c56edf1 tempest-VolumeDependencyTests-208774870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0.4ad25cc3-7485-4a49-94e2-ed9871ab3f96 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-12628333-87fe-4380-907e-b989d28a6397 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-12628333-87fe-4380-907e-b989d28a6397 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:56 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-12628333-87fe-4380-907e-b989d28a6397 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:56 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0.4ad25cc3-7485-4a49-94e2-ed9871ab3f96 Sep 01 08:34:56 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:56 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-12628333-87fe-4380-907e-b989d28a6397 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-12628333-87fe-4380-907e-b989d28a6397 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-12628333-87fe-4380-907e-b989d28a6397 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:56 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:34:56 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-841841b8-a53f-4c55-a0e0-15a052a17352 tempest-ProjectReaderTests-2124680279 None] Acquiring lock "cinder-74103094-7c6f-47c2-86cd-de4dd8a91ff7-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:56 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9cc484b9-ecbc-4e7f-8236-966a78c9906e tempest-CinderUnicodeTest-452759633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-4cc798f2-9b28-4db5-acdd-a887968c4169" returned: 0 in 0.363s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-841841b8-a53f-4c55-a0e0-15a052a17352 tempest-ProjectReaderTests-2124680279 None] Lock "cinder-74103094-7c6f-47c2-86cd-de4dd8a91ff7-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9cc484b9-ecbc-4e7f-8236-966a78c9906e tempest-CinderUnicodeTest-452759633 None] Lock "cinder-quobyte-4cc798f2-9b28-4db5-acdd-a887968c4169" released by "delete_volume" :: held 0.830s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-841841b8-a53f-4c55-a0e0-15a052a17352 tempest-ProjectReaderTests-2124680279 None] Acquiring lock "cinder-quobyte-74103094-7c6f-47c2-86cd-de4dd8a91ff7" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-841841b8-a53f-4c55-a0e0-15a052a17352 tempest-ProjectReaderTests-2124680279 None] Lock "cinder-quobyte-74103094-7c6f-47c2-86cd-de4dd8a91ff7" acquired by "delete_volume" :: waited 0.032s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:56 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-9cc484b9-ecbc-4e7f-8236-966a78c9906e tempest-CinderUnicodeTest-452759633 None] Created reservations ['acc5a5f1-a390-4352-8720-85ecc07a372b', '20e0bd01-d4b6-4e88-a61d-060454bbcdd9', 'e498a51f-8e42-4375-bb35-9106e333db7f', '1291ac3a-b767-4962-beac-526d82eae146'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:34:56 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[d296865e-239f-41ff-bd27-f92b0432343d]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-841841b8-a53f-4c55-a0e0-15a052a17352 tempest-ProjectReaderTests-2124680279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-74103094-7c6f-47c2-86cd-de4dd8a91ff7 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:57 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-12628333-87fe-4380-907e-b989d28a6397 tempest-CreateVolumesFromSnapshotTest-1684188918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.379s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:57 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-12628333-87fe-4380-907e-b989d28a6397 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:34:57 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-12628333-87fe-4380-907e-b989d28a6397 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Deleted volume successfully. Sep 01 08:34:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-12628333-87fe-4380-907e-b989d28a6397 tempest-CreateVolumesFromSnapshotTest-1684188918 None] Lock "cinder-64920481-9779-455e-8406-e32a3e1ead7e-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9cc484b9-ecbc-4e7f-8236-966a78c9906e tempest-CinderUnicodeTest-452759633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9cc484b9-ecbc-4e7f-8236-966a78c9906e tempest-CinderUnicodeTest-452759633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:57 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-9cc484b9-ecbc-4e7f-8236-966a78c9906e tempest-CinderUnicodeTest-452759633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-9cc484b9-ecbc-4e7f-8236-966a78c9906e tempest-CinderUnicodeTest-452759633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9cc484b9-ecbc-4e7f-8236-966a78c9906e tempest-CinderUnicodeTest-452759633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9cc484b9-ecbc-4e7f-8236-966a78c9906e tempest-CinderUnicodeTest-452759633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6a5a8f43-3b56-4e1d-8ab3-fea52c56edf1 tempest-VolumeDependencyTests-208774870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0.4ad25cc3-7485-4a49-94e2-ed9871ab3f96" returned: 0 in 0.509s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6a5a8f43-3b56-4e1d-8ab3-fea52c56edf1 tempest-VolumeDependencyTests-208774870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0.4ad25cc3-7485-4a49-94e2-ed9871ab3f96 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:57 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:34:57 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-74103094-7c6f-47c2-86cd-de4dd8a91ff7 Sep 01 08:34:57 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:57 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:57 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0.4ad25cc3-7485-4a49-94e2-ed9871ab3f96 Sep 01 08:34:57 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:57 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:57 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6a5a8f43-3b56-4e1d-8ab3-fea52c56edf1 tempest-VolumeDependencyTests-208774870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0.4ad25cc3-7485-4a49-94e2-ed9871ab3f96" returned: 0 in 0.270s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9cc484b9-ecbc-4e7f-8236-966a78c9906e tempest-CinderUnicodeTest-452759633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.285s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:57 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-9cc484b9-ecbc-4e7f-8236-966a78c9906e tempest-CinderUnicodeTest-452759633 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:34:57 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-9cc484b9-ecbc-4e7f-8236-966a78c9906e tempest-CinderUnicodeTest-452759633 None] Deleted volume successfully. Sep 01 08:34:57 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-841841b8-a53f-4c55-a0e0-15a052a17352 tempest-ProjectReaderTests-2124680279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-74103094-7c6f-47c2-86cd-de4dd8a91ff7" returned: 0 in 0.490s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-841841b8-a53f-4c55-a0e0-15a052a17352 tempest-ProjectReaderTests-2124680279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-74103094-7c6f-47c2-86cd-de4dd8a91ff7 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6a5a8f43-3b56-4e1d-8ab3-fea52c56edf1 tempest-VolumeDependencyTests-208774870 None] Lock "cinder-quobyte-4ad25cc3-7485-4a49-94e2-ed9871ab3f96" released by "_delete_snapshot" :: held 1.978s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6a5a8f43-3b56-4e1d-8ab3-fea52c56edf1 tempest-VolumeDependencyTests-208774870 None] Lock "cinder-quobyte-16a108aa-3f12-41a4-952a-bec9928f2ac0" released by "delete_snapshot" :: held 2.021s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:57 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-74103094-7c6f-47c2-86cd-de4dd8a91ff7 Sep 01 08:34:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-9cc484b9-ecbc-4e7f-8236-966a78c9906e tempest-CinderUnicodeTest-452759633 None] Lock "cinder-4cc798f2-9b28-4db5-acdd-a887968c4169-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:57 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:57 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-6a5a8f43-3b56-4e1d-8ab3-fea52c56edf1 tempest-VolumeDependencyTests-208774870 None] Created reservations ['277d4e81-f34d-4ea8-9b1c-7eb60a82026b', '1ce6f23d-33b7-4b51-ad1d-b6425111ab9c', '2e4ad36a-09a6-49ea-987b-6c04d46a9075', '2eb26e2a-9e13-40f0-aee0-e9b353ce2fcc'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:34:57 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-6a5a8f43-3b56-4e1d-8ab3-fea52c56edf1 tempest-VolumeDependencyTests-208774870 None] Delete snapshot completed successfully. Sep 01 08:34:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-6a5a8f43-3b56-4e1d-8ab3-fea52c56edf1 tempest-VolumeDependencyTests-208774870 None] Lock "cinder-4ad25cc3-7485-4a49-94e2-ed9871ab3f96-delete_snapshot" released by "delete_snapshot" :: held 2.225s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:57 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-841841b8-a53f-4c55-a0e0-15a052a17352 tempest-ProjectReaderTests-2124680279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-74103094-7c6f-47c2-86cd-de4dd8a91ff7" returned: 0 in 0.325s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-841841b8-a53f-4c55-a0e0-15a052a17352 tempest-ProjectReaderTests-2124680279 None] Lock "cinder-quobyte-74103094-7c6f-47c2-86cd-de4dd8a91ff7" released by "delete_volume" :: held 0.871s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:57 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-841841b8-a53f-4c55-a0e0-15a052a17352 tempest-ProjectReaderTests-2124680279 None] Created reservations ['f3a3776b-8d90-439e-97d9-1efc88b3ebca', '58026255-4716-4114-b0fe-eff88ea6acd3', 'b5dc9ed9-0986-4649-8e03-f8c1bc457b08', 'ec6236f9-87e7-4b60-b01e-663c3253c9b3'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:34:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-841841b8-a53f-4c55-a0e0-15a052a17352 tempest-ProjectReaderTests-2124680279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-841841b8-a53f-4c55-a0e0-15a052a17352 tempest-ProjectReaderTests-2124680279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-841841b8-a53f-4c55-a0e0-15a052a17352 tempest-ProjectReaderTests-2124680279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-841841b8-a53f-4c55-a0e0-15a052a17352 tempest-ProjectReaderTests-2124680279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-841841b8-a53f-4c55-a0e0-15a052a17352 tempest-ProjectReaderTests-2124680279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-841841b8-a53f-4c55-a0e0-15a052a17352 tempest-ProjectReaderTests-2124680279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:57 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:34:57 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:58 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-841841b8-a53f-4c55-a0e0-15a052a17352 tempest-ProjectReaderTests-2124680279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.272s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:58 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-841841b8-a53f-4c55-a0e0-15a052a17352 tempest-ProjectReaderTests-2124680279 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:34:58 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-841841b8-a53f-4c55-a0e0-15a052a17352 tempest-ProjectReaderTests-2124680279 None] Deleted volume successfully. Sep 01 08:34:58 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-841841b8-a53f-4c55-a0e0-15a052a17352 tempest-ProjectReaderTests-2124680279 None] Lock "cinder-74103094-7c6f-47c2-86cd-de4dd8a91ff7-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:58 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f180f0a0-76a7-4455-8a55-9ff5c54817b1 tempest-VolumeDependencyTests-208774870 None] Acquiring lock "cinder-16a108aa-3f12-41a4-952a-bec9928f2ac0-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:58 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f180f0a0-76a7-4455-8a55-9ff5c54817b1 tempest-VolumeDependencyTests-208774870 None] Lock "cinder-16a108aa-3f12-41a4-952a-bec9928f2ac0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:58 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f180f0a0-76a7-4455-8a55-9ff5c54817b1 tempest-VolumeDependencyTests-208774870 None] Acquiring lock "cinder-quobyte-16a108aa-3f12-41a4-952a-bec9928f2ac0" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:34:58 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f180f0a0-76a7-4455-8a55-9ff5c54817b1 tempest-VolumeDependencyTests-208774870 None] Lock "cinder-quobyte-16a108aa-3f12-41a4-952a-bec9928f2ac0" acquired by "delete_volume" :: waited 0.016s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:34:58 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03a2f07-0840-4be1-b5f3-9c2d92cc248d]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:34:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f180f0a0-76a7-4455-8a55-9ff5c54817b1 tempest-VolumeDependencyTests-208774870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:58 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0 Sep 01 08:34:58 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:59 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f180f0a0-76a7-4455-8a55-9ff5c54817b1 tempest-VolumeDependencyTests-208774870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0" returned: 0 in 0.520s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f180f0a0-76a7-4455-8a55-9ff5c54817b1 tempest-VolumeDependencyTests-208774870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:59 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0 Sep 01 08:34:59 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:59 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f180f0a0-76a7-4455-8a55-9ff5c54817b1 tempest-VolumeDependencyTests-208774870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-16a108aa-3f12-41a4-952a-bec9928f2ac0" returned: 0 in 0.323s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f180f0a0-76a7-4455-8a55-9ff5c54817b1 tempest-VolumeDependencyTests-208774870 None] Lock "cinder-quobyte-16a108aa-3f12-41a4-952a-bec9928f2ac0" released by "delete_volume" :: held 0.927s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] Flow 'volume_create_manager' (a85b099e-0d3b-4ef1-81a7-ee6de765af15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2347f17-b2e8-42a5-86a7-f15ab6fbbf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2347f17-b2e8-42a5-86a7-f15ab6fbbf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2040503525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e320ec97-af76-469b-a278-9cfe71f69cf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef3d7e19a16458a94ec8926ac2849da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:35:00Z,use_quota=True,user_id='999b77df2aa046688e87487a73e33751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52673651-d113-4135-a080-d0588ad46d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52673651-d113-4135-a080-d0588ad46d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2366367c-3829-4f9f-b5bb-8c7317f494ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2366367c-3829-4f9f-b5bb-8c7317f494ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e320ec97-af76-469b-a278-9cfe71f69cf8', 'volume_name': 'volume-e320ec97-af76-469b-a278-9cfe71f69cf8', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32508e92-8e1c-4605-a612-9185feeb8a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32508e92-8e1c-4605-a612-9185feeb8a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e64dd404-061d-4eeb-a03d-aa5f4c41f543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:34:59 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] Volume e320ec97-af76-469b-a278-9cfe71f69cf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e320ec97-af76-469b-a278-9cfe71f69cf8', 'volume_size': 1} Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2040503525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e320ec97-af76-469b-a278-9cfe71f69cf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef3d7e19a16458a94ec8926ac2849da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:35:00Z,use_quota=True,user_id='999b77df2aa046688e87487a73e33751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] Creating volume e320ec97-af76-469b-a278-9cfe71f69cf8 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:34:59 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e320ec97-af76-469b-a278-9cfe71f69cf8 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-f180f0a0-76a7-4455-8a55-9ff5c54817b1 tempest-VolumeDependencyTests-208774870 None] Created reservations ['6d55dc21-67b2-4e18-bafc-81719c89dea3', '97fceabc-1093-4e17-ac81-2bce1abfe0ab', 'ec0eb1aa-3a45-4e4f-8474-95cf957e8fd2', 'ac0c2258-274e-4b9c-9f6b-adca9b8688d3'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:34:59 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e320ec97-af76-469b-a278-9cfe71f69cf8 1073741824 Sep 01 08:34:59 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f180f0a0-76a7-4455-8a55-9ff5c54817b1 tempest-VolumeDependencyTests-208774870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f180f0a0-76a7-4455-8a55-9ff5c54817b1 tempest-VolumeDependencyTests-208774870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f180f0a0-76a7-4455-8a55-9ff5c54817b1 tempest-VolumeDependencyTests-208774870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f180f0a0-76a7-4455-8a55-9ff5c54817b1 tempest-VolumeDependencyTests-208774870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f180f0a0-76a7-4455-8a55-9ff5c54817b1 tempest-VolumeDependencyTests-208774870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:34:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f180f0a0-76a7-4455-8a55-9ff5c54817b1 tempest-VolumeDependencyTests-208774870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:34:59 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:34:59 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:00 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f180f0a0-76a7-4455-8a55-9ff5c54817b1 tempest-VolumeDependencyTests-208774870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.273s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:00 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-f180f0a0-76a7-4455-8a55-9ff5c54817b1 tempest-VolumeDependencyTests-208774870 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:35:00 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-f180f0a0-76a7-4455-8a55-9ff5c54817b1 tempest-VolumeDependencyTests-208774870 None] Deleted volume successfully. Sep 01 08:35:00 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f180f0a0-76a7-4455-8a55-9ff5c54817b1 tempest-VolumeDependencyTests-208774870 None] Lock "cinder-16a108aa-3f12-41a4-952a-bec9928f2ac0-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:00 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e320ec97-af76-469b-a278-9cfe71f69cf8 1073741824" returned: 0 in 0.572s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e320ec97-af76-469b-a278-9cfe71f69cf8 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:00 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e320ec97-af76-469b-a278-9cfe71f69cf8 Sep 01 08:35:00 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:00 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e320ec97-af76-469b-a278-9cfe71f69cf8" returned: 0 in 0.273s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:00 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:35:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:00 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e64dd404-061d-4eeb-a03d-aa5f4c41f543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e320ec97-af76-469b-a278-9cfe71f69cf8', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:00 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c82e5d4-a1a0-4240-9be5-e144ede95f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:00 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] Volume volume-e320ec97-af76-469b-a278-9cfe71f69cf8 (e320ec97-af76-469b-a278-9cfe71f69cf8): created successfully Sep 01 08:35:00 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c82e5d4-a1a0-4240-9be5-e144ede95f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:00 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] Flow 'volume_create_manager' (a85b099e-0d3b-4ef1-81a7-ee6de765af15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:35:00 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-921073e5-4ba0-42ba-a1ba-a3ad3324399c tempest-ProjectReaderTests-2124680279 None] Created volume successfully. Sep 01 08:35:00 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-66bba569-d2fb-442d-b4cd-487d8f06be2b tempest-VolumeDependencyTests-208774870 None] Acquiring lock "cinder-7be07c2b-afee-48df-9b0b-f0291442e0cc-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:00 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-66bba569-d2fb-442d-b4cd-487d8f06be2b tempest-VolumeDependencyTests-208774870 None] Lock "cinder-7be07c2b-afee-48df-9b0b-f0291442e0cc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:00 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-66bba569-d2fb-442d-b4cd-487d8f06be2b tempest-VolumeDependencyTests-208774870 None] Acquiring lock "cinder-quobyte-7be07c2b-afee-48df-9b0b-f0291442e0cc" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:00 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-66bba569-d2fb-442d-b4cd-487d8f06be2b tempest-VolumeDependencyTests-208774870 None] Lock "cinder-quobyte-7be07c2b-afee-48df-9b0b-f0291442e0cc" acquired by "delete_volume" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:00 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ce72f1-beca-4c6a-b0a9-c197b2b729b0]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:35:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-66bba569-d2fb-442d-b4cd-487d8f06be2b tempest-VolumeDependencyTests-208774870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7be07c2b-afee-48df-9b0b-f0291442e0cc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:01 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7be07c2b-afee-48df-9b0b-f0291442e0cc Sep 01 08:35:01 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:01 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-66bba569-d2fb-442d-b4cd-487d8f06be2b tempest-VolumeDependencyTests-208774870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7be07c2b-afee-48df-9b0b-f0291442e0cc" returned: 0 in 0.376s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-66bba569-d2fb-442d-b4cd-487d8f06be2b tempest-VolumeDependencyTests-208774870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7be07c2b-afee-48df-9b0b-f0291442e0cc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:01 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7be07c2b-afee-48df-9b0b-f0291442e0cc Sep 01 08:35:01 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:01 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-66bba569-d2fb-442d-b4cd-487d8f06be2b tempest-VolumeDependencyTests-208774870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7be07c2b-afee-48df-9b0b-f0291442e0cc" returned: 0 in 0.270s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:01 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-66bba569-d2fb-442d-b4cd-487d8f06be2b tempest-VolumeDependencyTests-208774870 None] Lock "cinder-quobyte-7be07c2b-afee-48df-9b0b-f0291442e0cc" released by "delete_volume" :: held 0.690s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:01 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-66bba569-d2fb-442d-b4cd-487d8f06be2b tempest-VolumeDependencyTests-208774870 None] Created reservations ['8b0d8a82-9f7a-4010-9692-1b416cee0afa', '57aaccea-c906-4173-b4d5-356dd49f96a9', '6316b3f6-c04a-4e80-8097-a5d5b6c541f4', '8ec3d859-4d1a-4c83-9ee7-e9c43438f050'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:35:01 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7a4875e7-4cb5-4678-9864-5f3c63b3c504 tempest-ProjectReaderTests-2124680279 None] Acquiring lock "cinder-e320ec97-af76-469b-a278-9cfe71f69cf8-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:01 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7a4875e7-4cb5-4678-9864-5f3c63b3c504 tempest-ProjectReaderTests-2124680279 None] Lock "cinder-e320ec97-af76-469b-a278-9cfe71f69cf8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-66bba569-d2fb-442d-b4cd-487d8f06be2b tempest-VolumeDependencyTests-208774870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-66bba569-d2fb-442d-b4cd-487d8f06be2b tempest-VolumeDependencyTests-208774870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:01 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-66bba569-d2fb-442d-b4cd-487d8f06be2b tempest-VolumeDependencyTests-208774870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:35:01 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-66bba569-d2fb-442d-b4cd-487d8f06be2b tempest-VolumeDependencyTests-208774870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:35:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-66bba569-d2fb-442d-b4cd-487d8f06be2b tempest-VolumeDependencyTests-208774870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-66bba569-d2fb-442d-b4cd-487d8f06be2b tempest-VolumeDependencyTests-208774870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:01 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:35:01 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:01 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7a4875e7-4cb5-4678-9864-5f3c63b3c504 tempest-ProjectReaderTests-2124680279 None] Acquiring lock "cinder-quobyte-e320ec97-af76-469b-a278-9cfe71f69cf8" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:01 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7a4875e7-4cb5-4678-9864-5f3c63b3c504 tempest-ProjectReaderTests-2124680279 None] Lock "cinder-quobyte-e320ec97-af76-469b-a278-9cfe71f69cf8" acquired by "delete_volume" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:01 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdfc7f6-7e07-424f-8449-2bf79d6dafdd]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:35:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7a4875e7-4cb5-4678-9864-5f3c63b3c504 tempest-ProjectReaderTests-2124680279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e320ec97-af76-469b-a278-9cfe71f69cf8 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:02 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e320ec97-af76-469b-a278-9cfe71f69cf8 Sep 01 08:35:02 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:02 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-66bba569-d2fb-442d-b4cd-487d8f06be2b tempest-VolumeDependencyTests-208774870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.334s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:02 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-66bba569-d2fb-442d-b4cd-487d8f06be2b tempest-VolumeDependencyTests-208774870 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:35:02 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-66bba569-d2fb-442d-b4cd-487d8f06be2b tempest-VolumeDependencyTests-208774870 None] Deleted volume successfully. Sep 01 08:35:02 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-66bba569-d2fb-442d-b4cd-487d8f06be2b tempest-VolumeDependencyTests-208774870 None] Lock "cinder-7be07c2b-afee-48df-9b0b-f0291442e0cc-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:02 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7a4875e7-4cb5-4678-9864-5f3c63b3c504 tempest-ProjectReaderTests-2124680279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e320ec97-af76-469b-a278-9cfe71f69cf8" returned: 0 in 0.501s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7a4875e7-4cb5-4678-9864-5f3c63b3c504 tempest-ProjectReaderTests-2124680279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e320ec97-af76-469b-a278-9cfe71f69cf8 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:02 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e320ec97-af76-469b-a278-9cfe71f69cf8 Sep 01 08:35:02 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:02 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7a4875e7-4cb5-4678-9864-5f3c63b3c504 tempest-ProjectReaderTests-2124680279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e320ec97-af76-469b-a278-9cfe71f69cf8" returned: 0 in 0.304s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:02 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7a4875e7-4cb5-4678-9864-5f3c63b3c504 tempest-ProjectReaderTests-2124680279 None] Lock "cinder-quobyte-e320ec97-af76-469b-a278-9cfe71f69cf8" released by "delete_volume" :: held 0.878s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:02 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-7a4875e7-4cb5-4678-9864-5f3c63b3c504 tempest-ProjectReaderTests-2124680279 None] Created reservations ['9b874c33-9ce7-4f35-b6e6-456e5bdf8f15', '60a3715f-58f2-4fea-8b36-883abe7a2450', 'bab644ef-827a-465c-aa72-64009ac6fca4', 'e6de3466-4988-472e-afad-fd4442e0abd9'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:35:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7a4875e7-4cb5-4678-9864-5f3c63b3c504 tempest-ProjectReaderTests-2124680279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7a4875e7-4cb5-4678-9864-5f3c63b3c504 tempest-ProjectReaderTests-2124680279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:02 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7a4875e7-4cb5-4678-9864-5f3c63b3c504 tempest-ProjectReaderTests-2124680279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:35:02 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7a4875e7-4cb5-4678-9864-5f3c63b3c504 tempest-ProjectReaderTests-2124680279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:35:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7a4875e7-4cb5-4678-9864-5f3c63b3c504 tempest-ProjectReaderTests-2124680279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7a4875e7-4cb5-4678-9864-5f3c63b3c504 tempest-ProjectReaderTests-2124680279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:03 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:35:03 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:03 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7a4875e7-4cb5-4678-9864-5f3c63b3c504 tempest-ProjectReaderTests-2124680279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.306s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:03 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-7a4875e7-4cb5-4678-9864-5f3c63b3c504 tempest-ProjectReaderTests-2124680279 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:35:03 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-7a4875e7-4cb5-4678-9864-5f3c63b3c504 tempest-ProjectReaderTests-2124680279 None] Deleted volume successfully. Sep 01 08:35:03 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7a4875e7-4cb5-4678-9864-5f3c63b3c504 tempest-ProjectReaderTests-2124680279 None] Lock "cinder-e320ec97-af76-469b-a278-9cfe71f69cf8-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:08 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=248,cinder:UPDATE=354,cinder:INSERT=80,cinder:DELETE=23 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:35:08 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:UPDATE=309,cinder:SELECT=215,cinder:DELETE=36,cinder:INSERT=85 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:35:08 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:35:08 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Flow 'volume_create_manager' (ebab491d-a8c3-47a2-860d-adfc655d0f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:35:08 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c568142-c41a-49ca-95fb-8a78881cb207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:08 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c568142-c41a-49ca-95fb-8a78881cb207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165da2be-1b77-418a-9607-e187589664a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d44f3741f24f52a6ddacfe9968f016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:35:09Z,use_quota=True,user_id='8cb7015cb8d1446288b8618f6d44570a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:09 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3030d581-cf65-44c2-9f77-4dcaf303d446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:09 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3030d581-cf65-44c2-9f77-4dcaf303d446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:09 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fda0368-1962-4b0e-b590-f95a0fae4cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:09 devstack cinder-volume[86893]: DEBUG cinder.image.glance [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Creating Keystone auth plugin from conf {{(pid=86893) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 08:35:09 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fda0368-1962-4b0e-b590-f95a0fae4cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '165da2be-1b77-418a-9607-e187589664a2', 'volume_name': 'volume-165da2be-1b77-418a-9607-e187589664a2', 'volume_size': 1, 'image_id': '5eb6f11c-4480-4548-b1d4-84158cef1a69', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5eb6f11c-4480-4548-b1d4-84158cef1a69', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9c96db60f34a10ea6821d09807f5a740', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '85d44f3741f24f52a6ddacfe9968f016', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4e9aadba4539e34ea1902771dfa32987cabce700d87572ccfdca2d24810c84f9ba200d6626725068e10aae1691214410333711c6d80b3d71e9117b258db15e8f', 'id': '5eb6f11c-4480-4548-b1d4-84158cef1a69', 'created_at': datetime.datetime(2026, 9, 1, 6, 35, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 6, 35, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5eb6f11c-4480-4548-b1d4-84158cef1a69/file', 'properties': {}}, 'image_service': }' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:09 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d2d593-7c4f-4055-8a69-eee6f9e49eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:09 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d2d593-7c4f-4055-8a69-eee6f9e49eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:09 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55f069b8-1537-4365-9666-4b986f7b5bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:09 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Volume 165da2be-1b77-418a-9607-e187589664a2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-165da2be-1b77-418a-9607-e187589664a2', 'volume_size': 1, 'image_id': '5eb6f11c-4480-4548-b1d4-84158cef1a69', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5eb6f11c-4480-4548-b1d4-84158cef1a69', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9c96db60f34a10ea6821d09807f5a740', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '85d44f3741f24f52a6ddacfe9968f016', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4e9aadba4539e34ea1902771dfa32987cabce700d87572ccfdca2d24810c84f9ba200d6626725068e10aae1691214410333711c6d80b3d71e9117b258db15e8f', 'id': '5eb6f11c-4480-4548-b1d4-84158cef1a69', 'created_at': datetime.datetime(2026, 9, 1, 6, 35, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 6, 35, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5eb6f11c-4480-4548-b1d4-84158cef1a69/file', 'properties': {}}, 'image_service': } Sep 01 08:35:09 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Trying to clone 165da2be-1b77-418a-9607-e187589664a2 from image 5eb6f11c-4480-4548-b1d4-84158cef1a69 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5eb6f11c-4480-4548-b1d4-84158cef1a69', 'metadata': {}}]). {{(pid=86893) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1100}} Sep 01 08:35:09 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5eb6f11c-4480-4548-b1d4-84158cef1a69_zvz4oi8udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86893) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 08:35:09 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Image download 0.00 MB at 0.00 MB/s Sep 01 08:35:09 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[61af050c-44e0-4afe-9621-a49a05a45e43]: (4, 'raw') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:35:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb6f11c-4480-4548-b1d4-84158cef1a69_zvz4oi8udevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:09 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb6f11c-4480-4548-b1d4-84158cef1a69_zvz4oi8udevstack@QuobyteHD Sep 01 08:35:09 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:09 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb6f11c-4480-4548-b1d4-84158cef1a69_zvz4oi8udevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb6f11c-4480-4548-b1d4-84158cef1a69_zvz4oi8udevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:09 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb6f11c-4480-4548-b1d4-84158cef1a69_zvz4oi8udevstack@QuobyteHD Sep 01 08:35:09 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:10 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb6f11c-4480-4548-b1d4-84158cef1a69_zvz4oi8udevstack@QuobyteHD" returned: 1 in 0.355s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb6f11c-4480-4548-b1d4-84158cef1a69_zvz4oi8udevstack@QuobyteHD' failed. Not Retrying. {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 08:35:10 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Temporary image 5eb6f11c-4480-4548-b1d4-84158cef1a69 is fetched for user 8cb7015cb8d1446288b8618f6d44570a. {{(pid=86893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 08:35:10 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dec63a-f56b-41c1-aa32-4bed9bbc2da9]: (4, 'raw') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:35:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb6f11c-4480-4548-b1d4-84158cef1a69_zvz4oi8udevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:10 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb6f11c-4480-4548-b1d4-84158cef1a69_zvz4oi8udevstack@QuobyteHD Sep 01 08:35:10 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:10 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb6f11c-4480-4548-b1d4-84158cef1a69_zvz4oi8udevstack@QuobyteHD" returned: 0 in 0.420s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb6f11c-4480-4548-b1d4-84158cef1a69_zvz4oi8udevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:10 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb6f11c-4480-4548-b1d4-84158cef1a69_zvz4oi8udevstack@QuobyteHD Sep 01 08:35:10 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:11 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb6f11c-4480-4548-b1d4-84158cef1a69_zvz4oi8udevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb6f11c-4480-4548-b1d4-84158cef1a69_zvz4oi8udevstack@QuobyteHD' failed. Not Retrying. {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 08:35:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:11 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165da2be-1b77-418a-9607-e187589664a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d44f3741f24f52a6ddacfe9968f016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:35:09Z,use_quota=True,user_id='8cb7015cb8d1446288b8618f6d44570a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:35:11 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Creating volume 165da2be-1b77-418a-9607-e187589664a2 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:35:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:11 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:35:11 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:35:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:11 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:35:11 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:35:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-165da2be-1b77-418a-9607-e187589664a2 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:11 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-165da2be-1b77-418a-9607-e187589664a2 1073741824 Sep 01 08:35:11 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:11 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-165da2be-1b77-418a-9607-e187589664a2 1073741824" returned: 0 in 0.474s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-165da2be-1b77-418a-9607-e187589664a2 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:11 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-165da2be-1b77-418a-9607-e187589664a2 Sep 01 08:35:11 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:11 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-165da2be-1b77-418a-9607-e187589664a2" returned: 0 in 0.279s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:11 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:35:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:11 devstack cinder-volume[86893]: DEBUG cinder.volume.volume_utils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Attempting download of 5eb6f11c-4480-4548-b1d4-84158cef1a69 ((None, [{'url': 'file:///opt/stack/data/glance/images/5eb6f11c-4480-4548-b1d4-84158cef1a69', 'metadata': {}}])) to volume 165da2be-1b77-418a-9607-e187589664a2. {{(pid=86893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 08:35:11 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa5276a-f7c0-425f-a175-bfe16363c296]: (4, 'raw') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:35:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5eb6f11c-4480-4548-b1d4-84158cef1a69_7gvdise_ {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:12 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5eb6f11c-4480-4548-b1d4-84158cef1a69_7gvdise_ Sep 01 08:35:12 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:12 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5eb6f11c-4480-4548-b1d4-84158cef1a69_7gvdise_" returned: 0 in 0.352s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5eb6f11c-4480-4548-b1d4-84158cef1a69_7gvdise_ {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:12 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5eb6f11c-4480-4548-b1d4-84158cef1a69_7gvdise_ Sep 01 08:35:12 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:12 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5eb6f11c-4480-4548-b1d4-84158cef1a69_7gvdise_" returned: 1 in 0.329s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5eb6f11c-4480-4548-b1d4-84158cef1a69_7gvdise_' failed. Not Retrying. {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 08:35:12 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70c1d26-7c39-4aa9-9931-52df766e6c84]: (4, 'raw') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:35:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb6f11c-4480-4548-b1d4-84158cef1a69_zvz4oi8udevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:12 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb6f11c-4480-4548-b1d4-84158cef1a69_zvz4oi8udevstack@QuobyteHD Sep 01 08:35:12 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:12 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb6f11c-4480-4548-b1d4-84158cef1a69_zvz4oi8udevstack@QuobyteHD" returned: 0 in 0.326s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb6f11c-4480-4548-b1d4-84158cef1a69_zvz4oi8udevstack@QuobyteHD {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:13 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb6f11c-4480-4548-b1d4-84158cef1a69_zvz4oi8udevstack@QuobyteHD Sep 01 08:35:13 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:13 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb6f11c-4480-4548-b1d4-84158cef1a69_zvz4oi8udevstack@QuobyteHD" returned: 1 in 0.332s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5eb6f11c-4480-4548-b1d4-84158cef1a69_zvz4oi8udevstack@QuobyteHD' failed. Not Retrying. {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 08:35:13 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] 5eb6f11c-4480-4548-b1d4-84158cef1a69 was raw, converting to qcow2 {{(pid=86893) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 08:35:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5eb6f11c-4480-4548-b1d4-84158cef1a69_zvz4oi8udevstack@QuobyteHD /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-165da2be-1b77-418a-9607-e187589664a2 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:13 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5eb6f11c-4480-4548-b1d4-84158cef1a69_zvz4oi8udevstack@QuobyteHD /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-165da2be-1b77-418a-9607-e187589664a2 Sep 01 08:35:13 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:13 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5eb6f11c-4480-4548-b1d4-84158cef1a69_zvz4oi8udevstack@QuobyteHD /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-165da2be-1b77-418a-9607-e187589664a2" returned: 0 in 0.507s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:13 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5eb6f11c-4480-4548-b1d4-84158cef1a69_zvz4oi8udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-165da2be-1b77-418a-9607-e187589664a2 {{(pid=86893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 08:35:13 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 08:35:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-165da2be-1b77-418a-9607-e187589664a2 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:13 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-165da2be-1b77-418a-9607-e187589664a2 1G Sep 01 08:35:13 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:14 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-165da2be-1b77-418a-9607-e187589664a2 1G" returned: 0 in 0.356s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:14 devstack cinder-volume[86893]: DEBUG cinder.volume.volume_utils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Downloaded image 5eb6f11c-4480-4548-b1d4-84158cef1a69 ((None, [{'url': 'file:///opt/stack/data/glance/images/5eb6f11c-4480-4548-b1d4-84158cef1a69', 'metadata': {}}])) to volume 165da2be-1b77-418a-9607-e187589664a2 successfully. {{(pid=86893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 08:35:14 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Temporary image 5eb6f11c-4480-4548-b1d4-84158cef1a69 for user 8cb7015cb8d1446288b8618f6d44570a is deleted. {{(pid=86893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 08:35:14 devstack cinder-volume[86893]: DEBUG cinder.volume.volume_utils [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Marking volume 165da2be-1b77-418a-9607-e187589664a2 as bootable. {{(pid=86893) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 08:35:14 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Copying metadata from image 5eb6f11c-4480-4548-b1d4-84158cef1a69 to 165da2be-1b77-418a-9607-e187589664a2. {{(pid=86893) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 08:35:14 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Creating volume glance metadata for volume 165da2be-1b77-418a-9607-e187589664a2 backed by image 5eb6f11c-4480-4548-b1d4-84158cef1a69 with: {'image_id': '5eb6f11c-4480-4548-b1d4-84158cef1a69', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9c96db60f34a10ea6821d09807f5a740', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86893) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 08:35:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55f069b8-1537-4365-9666-4b986f7b5bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-165da2be-1b77-418a-9607-e187589664a2', 'volume_size': 1, 'image_id': '5eb6f11c-4480-4548-b1d4-84158cef1a69', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5eb6f11c-4480-4548-b1d4-84158cef1a69', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9c96db60f34a10ea6821d09807f5a740', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '85d44f3741f24f52a6ddacfe9968f016', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4e9aadba4539e34ea1902771dfa32987cabce700d87572ccfdca2d24810c84f9ba200d6626725068e10aae1691214410333711c6d80b3d71e9117b258db15e8f', 'id': '5eb6f11c-4480-4548-b1d4-84158cef1a69', 'created_at': datetime.datetime(2026, 9, 1, 6, 35, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 6, 35, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5eb6f11c-4480-4548-b1d4-84158cef1a69/file', 'properties': {}}, 'image_service': }' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282f54bd-8599-432c-be75-a4f78a345cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:14 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Volume volume-165da2be-1b77-418a-9607-e187589664a2 (165da2be-1b77-418a-9607-e187589664a2): created successfully Sep 01 08:35:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282f54bd-8599-432c-be75-a4f78a345cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:14 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Flow 'volume_create_manager' (ebab491d-a8c3-47a2-860d-adfc655d0f92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:35:14 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-c5ab71ae-b2c8-4d61-9016-25a82baa2caa tempest-VolumeImageDependencyTests-25667890 None] Created volume successfully. Sep 01 08:35:15 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a3c50f6a-d296-4a83-83a2-afe31120a194 tempest-VolumeImageDependencyTests-25667890 None] Acquiring lock "cinder-165da2be-1b77-418a-9607-e187589664a2-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:15 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a3c50f6a-d296-4a83-83a2-afe31120a194 tempest-VolumeImageDependencyTests-25667890 None] Lock "cinder-165da2be-1b77-418a-9607-e187589664a2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:15 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a3c50f6a-d296-4a83-83a2-afe31120a194 tempest-VolumeImageDependencyTests-25667890 None] Acquiring lock "cinder-quobyte-165da2be-1b77-418a-9607-e187589664a2" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:15 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a3c50f6a-d296-4a83-83a2-afe31120a194 tempest-VolumeImageDependencyTests-25667890 None] Lock "cinder-quobyte-165da2be-1b77-418a-9607-e187589664a2" acquired by "delete_volume" :: waited 0.012s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:15 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce87edc9-a779-4e60-8a2e-bc1530581a12]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:35:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a3c50f6a-d296-4a83-83a2-afe31120a194 tempest-VolumeImageDependencyTests-25667890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-165da2be-1b77-418a-9607-e187589664a2 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:15 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-165da2be-1b77-418a-9607-e187589664a2 Sep 01 08:35:15 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:15 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a3c50f6a-d296-4a83-83a2-afe31120a194 tempest-VolumeImageDependencyTests-25667890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-165da2be-1b77-418a-9607-e187589664a2" returned: 0 in 0.378s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a3c50f6a-d296-4a83-83a2-afe31120a194 tempest-VolumeImageDependencyTests-25667890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-165da2be-1b77-418a-9607-e187589664a2 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:15 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-165da2be-1b77-418a-9607-e187589664a2 Sep 01 08:35:15 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:15 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a3c50f6a-d296-4a83-83a2-afe31120a194 tempest-VolumeImageDependencyTests-25667890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-165da2be-1b77-418a-9607-e187589664a2" returned: 0 in 0.256s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:16 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a3c50f6a-d296-4a83-83a2-afe31120a194 tempest-VolumeImageDependencyTests-25667890 None] Lock "cinder-quobyte-165da2be-1b77-418a-9607-e187589664a2" released by "delete_volume" :: held 0.682s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:16 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-a3c50f6a-d296-4a83-83a2-afe31120a194 tempest-VolumeImageDependencyTests-25667890 None] Created reservations ['db594108-ed81-4afa-a948-5d78b9947f08', 'cafde209-dc4f-4d68-946b-4a5b8efcc93d', 'c3aaa634-efd1-42a1-a65e-3810831999e0', '4d4acdf0-c485-4828-946d-06a2eb82465e'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:35:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a3c50f6a-d296-4a83-83a2-afe31120a194 tempest-VolumeImageDependencyTests-25667890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a3c50f6a-d296-4a83-83a2-afe31120a194 tempest-VolumeImageDependencyTests-25667890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a3c50f6a-d296-4a83-83a2-afe31120a194 tempest-VolumeImageDependencyTests-25667890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:35:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a3c50f6a-d296-4a83-83a2-afe31120a194 tempest-VolumeImageDependencyTests-25667890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:35:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a3c50f6a-d296-4a83-83a2-afe31120a194 tempest-VolumeImageDependencyTests-25667890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a3c50f6a-d296-4a83-83a2-afe31120a194 tempest-VolumeImageDependencyTests-25667890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:16 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:35:16 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:16 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a3c50f6a-d296-4a83-83a2-afe31120a194 tempest-VolumeImageDependencyTests-25667890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.254s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:16 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-a3c50f6a-d296-4a83-83a2-afe31120a194 tempest-VolumeImageDependencyTests-25667890 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:35:16 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-a3c50f6a-d296-4a83-83a2-afe31120a194 tempest-VolumeImageDependencyTests-25667890 None] Deleted volume successfully. Sep 01 08:35:16 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a3c50f6a-d296-4a83-83a2-afe31120a194 tempest-VolumeImageDependencyTests-25667890 None] Lock "cinder-165da2be-1b77-418a-9607-e187589664a2-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:20 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:35:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] Flow 'volume_create_manager' (fba03a50-c5bf-4489-b18b-c967b72c1220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:35:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19c57740-c2e6-48e9-a85d-a636f3d23e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19c57740-c2e6-48e9-a85d-a636f3d23e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-677189793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e919476f-25a0-4ebd-bad2-eb2b2e65e573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ceebf2b634a4548bbd4c6ae9db7ba5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:35:20Z,use_quota=True,user_id='983c5aa98b1a4e0bb6b0bb88c344af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb7b6efb-5a94-4478-b771-772606ad38ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb7b6efb-5a94-4478-b771-772606ad38ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e4f20b-d6d2-467d-9c25-9125332b8730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e4f20b-d6d2-467d-9c25-9125332b8730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e919476f-25a0-4ebd-bad2-eb2b2e65e573', 'volume_name': 'volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d893a3-a7bc-42ab-be20-34076e402bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d893a3-a7bc-42ab-be20-34076e402bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:20 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9fde124-1c6d-4789-8d1a-8f4e2d8cae8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:20 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] Volume e919476f-25a0-4ebd-bad2-eb2b2e65e573: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573', 'volume_size': 1} Sep 01 08:35:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-677189793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e919476f-25a0-4ebd-bad2-eb2b2e65e573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ceebf2b634a4548bbd4c6ae9db7ba5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:35:20Z,use_quota=True,user_id='983c5aa98b1a4e0bb6b0bb88c344af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:35:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] Creating volume e919476f-25a0-4ebd-bad2-eb2b2e65e573 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:35:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:35:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:35:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:20 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:35:20 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:35:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:20 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573 1073741824 Sep 01 08:35:20 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:21 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573 1073741824" returned: 0 in 0.504s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:21 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573 Sep 01 08:35:21 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:21 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573" returned: 0 in 0.272s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:35:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9fde124-1c6d-4789-8d1a-8f4e2d8cae8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffd15634-b112-4682-9c86-3b47b5443f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:21 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] Volume volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573 (e919476f-25a0-4ebd-bad2-eb2b2e65e573): created successfully Sep 01 08:35:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffd15634-b112-4682-9c86-3b47b5443f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:21 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] Flow 'volume_create_manager' (fba03a50-c5bf-4489-b18b-c967b72c1220) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:35:21 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-6405b69a-dc93-4a9f-859a-e66f1b8c73c3 tempest-ProjectMemberTests-966986526 None] Created volume successfully. Sep 01 08:35:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-47305b02-b206-4c90-9ca2-73545ecb2f46 tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-47305b02-b206-4c90-9ca2-73545ecb2f46 tempest-ProjectMemberTests-966986526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-47305b02-b206-4c90-9ca2-73545ecb2f46 tempest-ProjectMemberTests-966986526 None] Creating offline snapshot 79ed5bd0-e215-4189-87a2-06f01041a108 of volume e919476f-25a0-4ebd-bad2-eb2b2e65e573 {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:35:22 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[358e2a0a-33b0-47f3-876f-35a9009d7e5b]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:35:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-47305b02-b206-4c90-9ca2-73545ecb2f46 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:22 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573 Sep 01 08:35:22 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:23 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-47305b02-b206-4c90-9ca2-73545ecb2f46 tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573" returned: 0 in 0.419s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-47305b02-b206-4c90-9ca2-73545ecb2f46 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573.79ed5bd0-e215-4189-87a2-06f01041a108 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:23 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573.79ed5bd0-e215-4189-87a2-06f01041a108 1G Sep 01 08:35:23 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:23 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-47305b02-b206-4c90-9ca2-73545ecb2f46 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573.79ed5bd0-e215-4189-87a2-06f01041a108 1G" returned: 0 in 0.404s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-47305b02-b206-4c90-9ca2-73545ecb2f46 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573.79ed5bd0-e215-4189-87a2-06f01041a108 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:23 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573.79ed5bd0-e215-4189-87a2-06f01041a108 Sep 01 08:35:23 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:23 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-47305b02-b206-4c90-9ca2-73545ecb2f46 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573.79ed5bd0-e215-4189-87a2-06f01041a108" returned: 0 in 0.284s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:23 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-47305b02-b206-4c90-9ca2-73545ecb2f46 tempest-ProjectMemberTests-966986526 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573.79ed5bd0-e215-4189-87a2-06f01041a108 is being set with open permissions: ugo+rw Sep 01 08:35:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-47305b02-b206-4c90-9ca2-73545ecb2f46 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573.79ed5bd0-e215-4189-87a2-06f01041a108 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:23 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573.79ed5bd0-e215-4189-87a2-06f01041a108 Sep 01 08:35:23 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:24 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-47305b02-b206-4c90-9ca2-73545ecb2f46 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573.79ed5bd0-e215-4189-87a2-06f01041a108" returned: 0 in 0.323s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-47305b02-b206-4c90-9ca2-73545ecb2f46 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:24 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573.info Sep 01 08:35:24 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:24 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-47305b02-b206-4c90-9ca2-73545ecb2f46 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573.info" returned: 0 in 0.265s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:24 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-47305b02-b206-4c90-9ca2-73545ecb2f46 tempest-ProjectMemberTests-966986526 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573.info is being set with open permissions: ugo+rw Sep 01 08:35:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-47305b02-b206-4c90-9ca2-73545ecb2f46 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:24 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573.info Sep 01 08:35:24 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:24 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-47305b02-b206-4c90-9ca2-73545ecb2f46 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573.info" returned: 0 in 0.272s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-47305b02-b206-4c90-9ca2-73545ecb2f46 tempest-ProjectMemberTests-966986526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.073s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:24 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-47305b02-b206-4c90-9ca2-73545ecb2f46 tempest-ProjectMemberTests-966986526 None] Create snapshot completed successfully Sep 01 08:35:25 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b515c79f-2bb0-45d9-8879-22a4d8ab7643 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-79ed5bd0-e215-4189-87a2-06f01041a108-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:25 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b515c79f-2bb0-45d9-8879-22a4d8ab7643 tempest-ProjectMemberTests-966986526 None] Lock "cinder-79ed5bd0-e215-4189-87a2-06f01041a108-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:25 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b515c79f-2bb0-45d9-8879-22a4d8ab7643 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-quobyte-e919476f-25a0-4ebd-bad2-eb2b2e65e573" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:25 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b515c79f-2bb0-45d9-8879-22a4d8ab7643 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-e919476f-25a0-4ebd-bad2-eb2b2e65e573" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:25 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b515c79f-2bb0-45d9-8879-22a4d8ab7643 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-quobyte-79ed5bd0-e215-4189-87a2-06f01041a108" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:25 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b515c79f-2bb0-45d9-8879-22a4d8ab7643 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-79ed5bd0-e215-4189-87a2-06f01041a108" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-b515c79f-2bb0-45d9-8879-22a4d8ab7643 tempest-ProjectMemberTests-966986526 None] Deleting offline snapshot 79ed5bd0-e215-4189-87a2-06f01041a108 of volume e919476f-25a0-4ebd-bad2-eb2b2e65e573 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:35:26 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-b515c79f-2bb0-45d9-8879-22a4d8ab7643 tempest-ProjectMemberTests-966986526 None] snapshot_file for this snap is: volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573.79ed5bd0-e215-4189-87a2-06f01041a108 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:35:26 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cc8f2e-eed2-426a-a911-86bc24abe253]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:35:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b515c79f-2bb0-45d9-8879-22a4d8ab7643 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573.79ed5bd0-e215-4189-87a2-06f01041a108 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:26 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573.79ed5bd0-e215-4189-87a2-06f01041a108 Sep 01 08:35:26 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:26 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b515c79f-2bb0-45d9-8879-22a4d8ab7643 tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573.79ed5bd0-e215-4189-87a2-06f01041a108" returned: 0 in 0.412s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:26 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-b515c79f-2bb0-45d9-8879-22a4d8ab7643 tempest-ProjectMemberTests-966986526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:35:26 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e64306-7207-4bd7-aeb8-6a5b3ef32112]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:35:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b515c79f-2bb0-45d9-8879-22a4d8ab7643 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:26 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573 Sep 01 08:35:26 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:26 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b515c79f-2bb0-45d9-8879-22a4d8ab7643 tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573" returned: 0 in 0.384s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b515c79f-2bb0-45d9-8879-22a4d8ab7643 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573.79ed5bd0-e215-4189-87a2-06f01041a108 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:26 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573.79ed5bd0-e215-4189-87a2-06f01041a108 Sep 01 08:35:26 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:27 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b515c79f-2bb0-45d9-8879-22a4d8ab7643 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573.79ed5bd0-e215-4189-87a2-06f01041a108" returned: 0 in 0.354s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b515c79f-2bb0-45d9-8879-22a4d8ab7643 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573.79ed5bd0-e215-4189-87a2-06f01041a108 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:27 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573.79ed5bd0-e215-4189-87a2-06f01041a108 Sep 01 08:35:27 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:27 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b515c79f-2bb0-45d9-8879-22a4d8ab7643 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573.79ed5bd0-e215-4189-87a2-06f01041a108" returned: 0 in 0.257s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:27 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b515c79f-2bb0-45d9-8879-22a4d8ab7643 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-79ed5bd0-e215-4189-87a2-06f01041a108" released by "_delete_snapshot" :: held 1.530s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:27 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b515c79f-2bb0-45d9-8879-22a4d8ab7643 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-e919476f-25a0-4ebd-bad2-eb2b2e65e573" released by "delete_snapshot" :: held 1.553s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:27 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-b515c79f-2bb0-45d9-8879-22a4d8ab7643 tempest-ProjectMemberTests-966986526 None] Created reservations ['df49914d-b8a8-40a6-b82b-cc91bc2a78de', 'c2a1af60-e9e6-4eb7-b0a3-ae592628d291', 'a11d9854-e38f-4a58-9fc3-3b06d5b9b8a1', '560b8ed6-faa5-4099-9b2a-8bc12b272815'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:35:27 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-b515c79f-2bb0-45d9-8879-22a4d8ab7643 tempest-ProjectMemberTests-966986526 None] Delete snapshot completed successfully. Sep 01 08:35:27 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b515c79f-2bb0-45d9-8879-22a4d8ab7643 tempest-ProjectMemberTests-966986526 None] Lock "cinder-79ed5bd0-e215-4189-87a2-06f01041a108-delete_snapshot" released by "delete_snapshot" :: held 1.696s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-255e685a-b867-4b7e-934f-9fe5d89436b5 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-e919476f-25a0-4ebd-bad2-eb2b2e65e573-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-255e685a-b867-4b7e-934f-9fe5d89436b5 tempest-ProjectMemberTests-966986526 None] Lock "cinder-e919476f-25a0-4ebd-bad2-eb2b2e65e573-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-255e685a-b867-4b7e-934f-9fe5d89436b5 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-quobyte-e919476f-25a0-4ebd-bad2-eb2b2e65e573" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-255e685a-b867-4b7e-934f-9fe5d89436b5 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-e919476f-25a0-4ebd-bad2-eb2b2e65e573" acquired by "delete_volume" :: waited 0.019s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:28 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[739c0879-73bb-474d-83f2-45e91328917c]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:35:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-255e685a-b867-4b7e-934f-9fe5d89436b5 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:28 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573 Sep 01 08:35:28 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:28 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-255e685a-b867-4b7e-934f-9fe5d89436b5 tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573" returned: 0 in 0.400s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-255e685a-b867-4b7e-934f-9fe5d89436b5 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:28 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573 Sep 01 08:35:28 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:28 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-255e685a-b867-4b7e-934f-9fe5d89436b5 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e919476f-25a0-4ebd-bad2-eb2b2e65e573" returned: 0 in 0.328s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-255e685a-b867-4b7e-934f-9fe5d89436b5 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-e919476f-25a0-4ebd-bad2-eb2b2e65e573" released by "delete_volume" :: held 0.790s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-255e685a-b867-4b7e-934f-9fe5d89436b5 tempest-ProjectMemberTests-966986526 None] Created reservations ['4c2fb1ab-0ee0-43dc-8f84-ff1d7f1ac0fb', '64e797a1-331d-495f-97ae-400cc7646ac4', '28dd7bad-c012-429e-a0c9-ef41033c7f2e', 'f1d3efc2-ec31-4377-8a13-20797a0aba41'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-255e685a-b867-4b7e-934f-9fe5d89436b5 tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-255e685a-b867-4b7e-934f-9fe5d89436b5 tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-255e685a-b867-4b7e-934f-9fe5d89436b5 tempest-ProjectMemberTests-966986526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-255e685a-b867-4b7e-934f-9fe5d89436b5 tempest-ProjectMemberTests-966986526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-255e685a-b867-4b7e-934f-9fe5d89436b5 tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-255e685a-b867-4b7e-934f-9fe5d89436b5 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:29 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:35:29 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:29 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-255e685a-b867-4b7e-934f-9fe5d89436b5 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.333s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-255e685a-b867-4b7e-934f-9fe5d89436b5 tempest-ProjectMemberTests-966986526 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:35:29 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-255e685a-b867-4b7e-934f-9fe5d89436b5 tempest-ProjectMemberTests-966986526 None] Deleted volume successfully. Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-255e685a-b867-4b7e-934f-9fe5d89436b5 tempest-ProjectMemberTests-966986526 None] Lock "cinder-e919476f-25a0-4ebd-bad2-eb2b2e65e573-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] Flow 'volume_create_manager' (7ede4641-44d4-4d7c-99ed-c7b287c4ee50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8f4268-9f83-4cc1-b42f-47e0c92b33e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8f4268-9f83-4cc1-b42f-47e0c92b33e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1490379727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99cc0e71-7a75-4881-87cb-1b59113492df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ceebf2b634a4548bbd4c6ae9db7ba5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:35:30Z,use_quota=True,user_id='983c5aa98b1a4e0bb6b0bb88c344af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9837062-d519-4abf-83fa-7aeb5103b834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9837062-d519-4abf-83fa-7aeb5103b834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58432eb5-b24a-4edd-a148-9670d4b5ac9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58432eb5-b24a-4edd-a148-9670d4b5ac9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99cc0e71-7a75-4881-87cb-1b59113492df', 'volume_name': 'volume-99cc0e71-7a75-4881-87cb-1b59113492df', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15e98e7-793c-49e8-b190-243c81292e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15e98e7-793c-49e8-b190-243c81292e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60dfe12e-8f8f-4ea0-9d6d-f22b00ff355d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:29 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] Volume 99cc0e71-7a75-4881-87cb-1b59113492df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99cc0e71-7a75-4881-87cb-1b59113492df', 'volume_size': 1} Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1490379727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99cc0e71-7a75-4881-87cb-1b59113492df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ceebf2b634a4548bbd4c6ae9db7ba5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:35:30Z,use_quota=True,user_id='983c5aa98b1a4e0bb6b0bb88c344af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] Creating volume 99cc0e71-7a75-4881-87cb-1b59113492df {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:35:29 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:35:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:29 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df 1073741824 Sep 01 08:35:29 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:30 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df 1073741824" returned: 0 in 0.473s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:30 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df Sep 01 08:35:30 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:30 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df" returned: 0 in 0.286s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:35:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60dfe12e-8f8f-4ea0-9d6d-f22b00ff355d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99cc0e71-7a75-4881-87cb-1b59113492df', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6dcdb01-6b83-49de-a26c-a85c9c22b227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:30 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] Volume volume-99cc0e71-7a75-4881-87cb-1b59113492df (99cc0e71-7a75-4881-87cb-1b59113492df): created successfully Sep 01 08:35:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6dcdb01-6b83-49de-a26c-a85c9c22b227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] Flow 'volume_create_manager' (7ede4641-44d4-4d7c-99ed-c7b287c4ee50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:35:30 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-51055ecc-af25-4083-9f58-cfe52af5dd83 tempest-ProjectMemberTests-966986526 None] Created volume successfully. Sep 01 08:35:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:35:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:35:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:35:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:31 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:35:31 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:31 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.262s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:31 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:35:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager._thread_info {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:35:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread count: 28 {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 08:35:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread info: [<_MainThread(MainThread, started 138934582050944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 08:35:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9cf75386-eeb3-47da-9676-1b636888d43e tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9cf75386-eeb3-47da-9676-1b636888d43e tempest-ProjectMemberTests-966986526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:32 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-9cf75386-eeb3-47da-9676-1b636888d43e tempest-ProjectMemberTests-966986526 None] Creating offline snapshot 11fe9b24-58a7-4ab9-a6e7-f6cfd4e2b932 of volume 99cc0e71-7a75-4881-87cb-1b59113492df {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:35:32 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[459571ea-23f2-4ca6-842e-9c18d239bae6]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:35:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9cf75386-eeb3-47da-9676-1b636888d43e tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:32 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df Sep 01 08:35:32 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:32 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9cf75386-eeb3-47da-9676-1b636888d43e tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df" returned: 0 in 0.354s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9cf75386-eeb3-47da-9676-1b636888d43e tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df.11fe9b24-58a7-4ab9-a6e7-f6cfd4e2b932 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:32 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df.11fe9b24-58a7-4ab9-a6e7-f6cfd4e2b932 1G Sep 01 08:35:32 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:32 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9cf75386-eeb3-47da-9676-1b636888d43e tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df.11fe9b24-58a7-4ab9-a6e7-f6cfd4e2b932 1G" returned: 0 in 0.400s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9cf75386-eeb3-47da-9676-1b636888d43e tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99cc0e71-7a75-4881-87cb-1b59113492df -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df.11fe9b24-58a7-4ab9-a6e7-f6cfd4e2b932 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:32 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99cc0e71-7a75-4881-87cb-1b59113492df -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df.11fe9b24-58a7-4ab9-a6e7-f6cfd4e2b932 Sep 01 08:35:32 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:33 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9cf75386-eeb3-47da-9676-1b636888d43e tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99cc0e71-7a75-4881-87cb-1b59113492df -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df.11fe9b24-58a7-4ab9-a6e7-f6cfd4e2b932" returned: 0 in 0.343s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:33 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-9cf75386-eeb3-47da-9676-1b636888d43e tempest-ProjectMemberTests-966986526 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df.11fe9b24-58a7-4ab9-a6e7-f6cfd4e2b932 is being set with open permissions: ugo+rw Sep 01 08:35:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9cf75386-eeb3-47da-9676-1b636888d43e tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df.11fe9b24-58a7-4ab9-a6e7-f6cfd4e2b932 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:33 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df.11fe9b24-58a7-4ab9-a6e7-f6cfd4e2b932 Sep 01 08:35:33 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:33 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9cf75386-eeb3-47da-9676-1b636888d43e tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df.11fe9b24-58a7-4ab9-a6e7-f6cfd4e2b932" returned: 0 in 0.253s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9cf75386-eeb3-47da-9676-1b636888d43e tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:33 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df.info Sep 01 08:35:33 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:33 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9cf75386-eeb3-47da-9676-1b636888d43e tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df.info" returned: 0 in 0.258s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:33 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-9cf75386-eeb3-47da-9676-1b636888d43e tempest-ProjectMemberTests-966986526 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df.info is being set with open permissions: ugo+rw Sep 01 08:35:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9cf75386-eeb3-47da-9676-1b636888d43e tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:33 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df.info Sep 01 08:35:33 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:34 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-9cf75386-eeb3-47da-9676-1b636888d43e tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df.info" returned: 0 in 0.235s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-9cf75386-eeb3-47da-9676-1b636888d43e tempest-ProjectMemberTests-966986526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.932s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:34 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-9cf75386-eeb3-47da-9676-1b636888d43e tempest-ProjectMemberTests-966986526 None] Create snapshot completed successfully Sep 01 08:35:34 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7127cd04-47ea-458a-882e-4a7160f22c80 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-11fe9b24-58a7-4ab9-a6e7-f6cfd4e2b932-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:34 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7127cd04-47ea-458a-882e-4a7160f22c80 tempest-ProjectMemberTests-966986526 None] Lock "cinder-11fe9b24-58a7-4ab9-a6e7-f6cfd4e2b932-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:34 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7127cd04-47ea-458a-882e-4a7160f22c80 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-quobyte-99cc0e71-7a75-4881-87cb-1b59113492df" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:34 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7127cd04-47ea-458a-882e-4a7160f22c80 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-99cc0e71-7a75-4881-87cb-1b59113492df" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:34 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7127cd04-47ea-458a-882e-4a7160f22c80 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-quobyte-11fe9b24-58a7-4ab9-a6e7-f6cfd4e2b932" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:34 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7127cd04-47ea-458a-882e-4a7160f22c80 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-11fe9b24-58a7-4ab9-a6e7-f6cfd4e2b932" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-7127cd04-47ea-458a-882e-4a7160f22c80 tempest-ProjectMemberTests-966986526 None] Deleting offline snapshot 11fe9b24-58a7-4ab9-a6e7-f6cfd4e2b932 of volume 99cc0e71-7a75-4881-87cb-1b59113492df {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:35:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-7127cd04-47ea-458a-882e-4a7160f22c80 tempest-ProjectMemberTests-966986526 None] snapshot_file for this snap is: volume-99cc0e71-7a75-4881-87cb-1b59113492df.11fe9b24-58a7-4ab9-a6e7-f6cfd4e2b932 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:35:34 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac8de03-070c-4968-9966-51c9000db531]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:35:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7127cd04-47ea-458a-882e-4a7160f22c80 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df.11fe9b24-58a7-4ab9-a6e7-f6cfd4e2b932 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:34 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df.11fe9b24-58a7-4ab9-a6e7-f6cfd4e2b932 Sep 01 08:35:34 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:34 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7127cd04-47ea-458a-882e-4a7160f22c80 tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df.11fe9b24-58a7-4ab9-a6e7-f6cfd4e2b932" returned: 0 in 0.425s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:34 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-7127cd04-47ea-458a-882e-4a7160f22c80 tempest-ProjectMemberTests-966986526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99cc0e71-7a75-4881-87cb-1b59113492df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:35:34 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[124931d5-4bfc-4ba6-bc42-e86ec5f7d4d6]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:35:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7127cd04-47ea-458a-882e-4a7160f22c80 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:34 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df Sep 01 08:35:34 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:35 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7127cd04-47ea-458a-882e-4a7160f22c80 tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df" returned: 0 in 0.426s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7127cd04-47ea-458a-882e-4a7160f22c80 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df.11fe9b24-58a7-4ab9-a6e7-f6cfd4e2b932 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:35 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df.11fe9b24-58a7-4ab9-a6e7-f6cfd4e2b932 Sep 01 08:35:35 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:35 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7127cd04-47ea-458a-882e-4a7160f22c80 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df.11fe9b24-58a7-4ab9-a6e7-f6cfd4e2b932" returned: 0 in 0.383s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7127cd04-47ea-458a-882e-4a7160f22c80 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df.11fe9b24-58a7-4ab9-a6e7-f6cfd4e2b932 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:35 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df.11fe9b24-58a7-4ab9-a6e7-f6cfd4e2b932 Sep 01 08:35:35 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:35 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7127cd04-47ea-458a-882e-4a7160f22c80 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df.11fe9b24-58a7-4ab9-a6e7-f6cfd4e2b932" returned: 0 in 0.255s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7127cd04-47ea-458a-882e-4a7160f22c80 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-11fe9b24-58a7-4ab9-a6e7-f6cfd4e2b932" released by "_delete_snapshot" :: held 1.625s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7127cd04-47ea-458a-882e-4a7160f22c80 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-99cc0e71-7a75-4881-87cb-1b59113492df" released by "delete_snapshot" :: held 1.658s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:36 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-7127cd04-47ea-458a-882e-4a7160f22c80 tempest-ProjectMemberTests-966986526 None] Created reservations ['5d7c60b9-10cb-41f8-b10c-f4670a9d99f1', '6730f44e-807c-43f7-b85a-3897155e2314', '9514b87d-6477-4c31-849f-8701f190f143', 'a5546760-2d37-4771-bf1e-37bc5685e60f'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:35:36 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-7127cd04-47ea-458a-882e-4a7160f22c80 tempest-ProjectMemberTests-966986526 None] Delete snapshot completed successfully. Sep 01 08:35:36 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7127cd04-47ea-458a-882e-4a7160f22c80 tempest-ProjectMemberTests-966986526 None] Lock "cinder-11fe9b24-58a7-4ab9-a6e7-f6cfd4e2b932-delete_snapshot" released by "delete_snapshot" :: held 1.831s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:36 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e98b5c42-5850-454d-b070-bcd59ed8bba3 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-99cc0e71-7a75-4881-87cb-1b59113492df-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:36 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e98b5c42-5850-454d-b070-bcd59ed8bba3 tempest-ProjectMemberTests-966986526 None] Lock "cinder-99cc0e71-7a75-4881-87cb-1b59113492df-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:36 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e98b5c42-5850-454d-b070-bcd59ed8bba3 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-quobyte-99cc0e71-7a75-4881-87cb-1b59113492df" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:36 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e98b5c42-5850-454d-b070-bcd59ed8bba3 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-99cc0e71-7a75-4881-87cb-1b59113492df" acquired by "delete_volume" :: waited 0.021s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:36 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[40907a1a-407a-4a8a-b83e-82ef7ec91560]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:35:36 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e98b5c42-5850-454d-b070-bcd59ed8bba3 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:36 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df Sep 01 08:35:36 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:37 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e98b5c42-5850-454d-b070-bcd59ed8bba3 tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df" returned: 0 in 0.392s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e98b5c42-5850-454d-b070-bcd59ed8bba3 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:37 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df Sep 01 08:35:37 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:37 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e98b5c42-5850-454d-b070-bcd59ed8bba3 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-99cc0e71-7a75-4881-87cb-1b59113492df" returned: 0 in 0.259s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e98b5c42-5850-454d-b070-bcd59ed8bba3 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-99cc0e71-7a75-4881-87cb-1b59113492df" released by "delete_volume" :: held 0.732s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:37 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-e98b5c42-5850-454d-b070-bcd59ed8bba3 tempest-ProjectMemberTests-966986526 None] Created reservations ['f52e0597-ca79-40d4-8a2b-bfb934ae1140', 'e290ebdc-0019-49c1-8a7a-37acd97de8d4', 'fd7cb8a4-1f6c-4479-82a2-deb9fc7d0bac', '879a50ea-6bfd-4f16-a180-0e12d1b69837'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:35:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e98b5c42-5850-454d-b070-bcd59ed8bba3 tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e98b5c42-5850-454d-b070-bcd59ed8bba3 tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e98b5c42-5850-454d-b070-bcd59ed8bba3 tempest-ProjectMemberTests-966986526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:35:37 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e98b5c42-5850-454d-b070-bcd59ed8bba3 tempest-ProjectMemberTests-966986526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:35:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e98b5c42-5850-454d-b070-bcd59ed8bba3 tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e98b5c42-5850-454d-b070-bcd59ed8bba3 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:37 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:35:37 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:37 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:37 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e98b5c42-5850-454d-b070-bcd59ed8bba3 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.282s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:37 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-e98b5c42-5850-454d-b070-bcd59ed8bba3 tempest-ProjectMemberTests-966986526 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:35:37 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-e98b5c42-5850-454d-b070-bcd59ed8bba3 tempest-ProjectMemberTests-966986526 None] Deleted volume successfully. Sep 01 08:35:37 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e98b5c42-5850-454d-b070-bcd59ed8bba3 tempest-ProjectMemberTests-966986526 None] Lock "cinder-99cc0e71-7a75-4881-87cb-1b59113492df-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:38 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:35:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] Flow 'volume_create_manager' (b0b790df-41bf-40c1-bac5-d95e02322cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:35:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a56199-b6dd-4bb3-87d1-1d358f0b3af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a56199-b6dd-4bb3-87d1-1d358f0b3af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-86003844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ceebf2b634a4548bbd4c6ae9db7ba5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:35:38Z,use_quota=True,user_id='983c5aa98b1a4e0bb6b0bb88c344af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0feaa742-3936-464f-a215-7dd85dfd1dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0feaa742-3936-464f-a215-7dd85dfd1dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de91f20a-a6d6-4a61-acd1-56e565e424f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de91f20a-a6d6-4a61-acd1-56e565e424f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf', 'volume_name': 'volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48941d3a-4750-4a99-9889-f163aa303ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48941d3a-4750-4a99-9889-f163aa303ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:38 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (814ceb06-5691-49c9-9971-dd921027874b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:38 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] Volume ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf', 'volume_size': 1} Sep 01 08:35:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-86003844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ceebf2b634a4548bbd4c6ae9db7ba5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:35:38Z,use_quota=True,user_id='983c5aa98b1a4e0bb6b0bb88c344af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:35:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] Creating volume ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:35:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:35:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:35:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:38 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:35:38 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:35:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:38 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf 1073741824 Sep 01 08:35:38 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:38 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf 1073741824" returned: 0 in 0.457s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:38 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:38 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf Sep 01 08:35:38 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:39 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf" returned: 0 in 0.270s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:35:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (814ceb06-5691-49c9-9971-dd921027874b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86114a5-ef3f-43ba-83e6-0daf7d1e60de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:39 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] Volume volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf (ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf): created successfully Sep 01 08:35:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86114a5-ef3f-43ba-83e6-0daf7d1e60de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] Flow 'volume_create_manager' (b0b790df-41bf-40c1-bac5-d95e02322cc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:35:39 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-636a0794-58d6-4fa9-aee7-17225164bc69 tempest-ProjectMemberTests-966986526 None] Created volume successfully. Sep 01 08:35:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-07345e36-a9b9-4f54-8ac5-28eeb5afa411 tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-07345e36-a9b9-4f54-8ac5-28eeb5afa411 tempest-ProjectMemberTests-966986526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:40 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-07345e36-a9b9-4f54-8ac5-28eeb5afa411 tempest-ProjectMemberTests-966986526 None] Creating offline snapshot 5e7f2a2f-5952-4124-b9e0-5809f0381571 of volume ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:35:40 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[300fa2d5-7840-41f1-8e28-a166ae834fba]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:35:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-07345e36-a9b9-4f54-8ac5-28eeb5afa411 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:40 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf Sep 01 08:35:40 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:40 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:35:40 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] Flow 'volume_create_manager' (bf86fee5-a3e3-4234-8b0c-5b76848aef8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:35:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40ac07d7-65ad-4539-8213-5a41dc470c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-07345e36-a9b9-4f54-8ac5-28eeb5afa411 tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf" returned: 0 in 0.407s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-07345e36-a9b9-4f54-8ac5-28eeb5afa411 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf.5e7f2a2f-5952-4124-b9e0-5809f0381571 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:40 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf.5e7f2a2f-5952-4124-b9e0-5809f0381571 1G Sep 01 08:35:40 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40ac07d7-65ad-4539-8213-5a41dc470c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-193584236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=451cc584-8ac8-407b-9ba8-da88638050ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d711a6760d1f4058991a452c40a4eb0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:35:41Z,use_quota=True,user_id='3e9cbd0767aa4eb3a5610fa00043cbef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c16955-dd7a-4e37-ac95-3a02e40b2f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c16955-dd7a-4e37-ac95-3a02e40b2f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e6eb49-d1a0-455f-afa7-1b7ee667cbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e6eb49-d1a0-455f-afa7-1b7ee667cbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '451cc584-8ac8-407b-9ba8-da88638050ff', 'volume_name': 'volume-451cc584-8ac8-407b-9ba8-da88638050ff', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af7fbed4-1590-4fbb-bb5f-d3a30d00a4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af7fbed4-1590-4fbb-bb5f-d3a30d00a4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c27d8b-ca30-4215-9932-3fd31a423757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:40 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] Volume 451cc584-8ac8-407b-9ba8-da88638050ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-451cc584-8ac8-407b-9ba8-da88638050ff', 'volume_size': 1} Sep 01 08:35:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:41 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-07345e36-a9b9-4f54-8ac5-28eeb5afa411 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf.5e7f2a2f-5952-4124-b9e0-5809f0381571 1G" returned: 0 in 0.377s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-07345e36-a9b9-4f54-8ac5-28eeb5afa411 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf.5e7f2a2f-5952-4124-b9e0-5809f0381571 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:41 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf.5e7f2a2f-5952-4124-b9e0-5809f0381571 Sep 01 08:35:41 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:41 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-07345e36-a9b9-4f54-8ac5-28eeb5afa411 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf.5e7f2a2f-5952-4124-b9e0-5809f0381571" returned: 0 in 0.287s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:41 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-07345e36-a9b9-4f54-8ac5-28eeb5afa411 tempest-ProjectMemberTests-966986526 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf.5e7f2a2f-5952-4124-b9e0-5809f0381571 is being set with open permissions: ugo+rw Sep 01 08:35:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-07345e36-a9b9-4f54-8ac5-28eeb5afa411 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf.5e7f2a2f-5952-4124-b9e0-5809f0381571 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:41 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf.5e7f2a2f-5952-4124-b9e0-5809f0381571 Sep 01 08:35:41 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:41 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-07345e36-a9b9-4f54-8ac5-28eeb5afa411 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf.5e7f2a2f-5952-4124-b9e0-5809f0381571" returned: 0 in 0.239s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-07345e36-a9b9-4f54-8ac5-28eeb5afa411 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:41 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf.info Sep 01 08:35:41 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:42 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-07345e36-a9b9-4f54-8ac5-28eeb5afa411 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf.info" returned: 0 in 0.246s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:42 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-07345e36-a9b9-4f54-8ac5-28eeb5afa411 tempest-ProjectMemberTests-966986526 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf.info is being set with open permissions: ugo+rw Sep 01 08:35:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-07345e36-a9b9-4f54-8ac5-28eeb5afa411 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:42 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf.info Sep 01 08:35:42 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:42 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-07345e36-a9b9-4f54-8ac5-28eeb5afa411 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf.info" returned: 0 in 0.233s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-07345e36-a9b9-4f54-8ac5-28eeb5afa411 tempest-ProjectMemberTests-966986526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.870s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.365s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-193584236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=451cc584-8ac8-407b-9ba8-da88638050ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d711a6760d1f4058991a452c40a4eb0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:35:41Z,use_quota=True,user_id='3e9cbd0767aa4eb3a5610fa00043cbef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:35:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] Creating volume 451cc584-8ac8-407b-9ba8-da88638050ff {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:35:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:35:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:35:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:35:42 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:35:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:42 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff 1073741824 Sep 01 08:35:42 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:42 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-07345e36-a9b9-4f54-8ac5-28eeb5afa411 tempest-ProjectMemberTests-966986526 None] Create snapshot completed successfully Sep 01 08:35:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-27a648f8-46e9-48df-855b-89bd89e46c81 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-5e7f2a2f-5952-4124-b9e0-5809f0381571-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-27a648f8-46e9-48df-855b-89bd89e46c81 tempest-ProjectMemberTests-966986526 None] Lock "cinder-5e7f2a2f-5952-4124-b9e0-5809f0381571-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-27a648f8-46e9-48df-855b-89bd89e46c81 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-quobyte-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-27a648f8-46e9-48df-855b-89bd89e46c81 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-27a648f8-46e9-48df-855b-89bd89e46c81 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-quobyte-5e7f2a2f-5952-4124-b9e0-5809f0381571" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-27a648f8-46e9-48df-855b-89bd89e46c81 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-5e7f2a2f-5952-4124-b9e0-5809f0381571" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-27a648f8-46e9-48df-855b-89bd89e46c81 tempest-ProjectMemberTests-966986526 None] Deleting offline snapshot 5e7f2a2f-5952-4124-b9e0-5809f0381571 of volume ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:35:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-27a648f8-46e9-48df-855b-89bd89e46c81 tempest-ProjectMemberTests-966986526 None] snapshot_file for this snap is: volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf.5e7f2a2f-5952-4124-b9e0-5809f0381571 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:35:42 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b1010f-a58c-4da3-9ae7-817c096e5923]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:35:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27a648f8-46e9-48df-855b-89bd89e46c81 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf.5e7f2a2f-5952-4124-b9e0-5809f0381571 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:42 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff 1073741824" returned: 0 in 0.431s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:42 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf.5e7f2a2f-5952-4124-b9e0-5809f0381571 Sep 01 08:35:42 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:42 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff Sep 01 08:35:42 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:42 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27a648f8-46e9-48df-855b-89bd89e46c81 tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf.5e7f2a2f-5952-4124-b9e0-5809f0381571" returned: 0 in 0.369s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-27a648f8-46e9-48df-855b-89bd89e46c81 tempest-ProjectMemberTests-966986526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:35:43 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff" returned: 0 in 0.244s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:43 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:35:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:43 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0e5053-452d-4bb9-b2d0-85cfe9c120d1]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:35:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27a648f8-46e9-48df-855b-89bd89e46c81 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:43 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c27d8b-ca30-4215-9932-3fd31a423757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-451cc584-8ac8-407b-9ba8-da88638050ff', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:43 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b849602-2f3e-4067-89d2-8b3e987e1ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:43 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] Volume volume-451cc584-8ac8-407b-9ba8-da88638050ff (451cc584-8ac8-407b-9ba8-da88638050ff): created successfully Sep 01 08:35:43 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b849602-2f3e-4067-89d2-8b3e987e1ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:43 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] Flow 'volume_create_manager' (bf86fee5-a3e3-4234-8b0c-5b76848aef8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:35:43 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-98ea7002-0dd8-431a-b1d2-b6d38bcdfdf5 tempest-SnapshotDependencyTests-53946882 None] Created volume successfully. Sep 01 08:35:43 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf Sep 01 08:35:43 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:43 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27a648f8-46e9-48df-855b-89bd89e46c81 tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf" returned: 0 in 0.357s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27a648f8-46e9-48df-855b-89bd89e46c81 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf.5e7f2a2f-5952-4124-b9e0-5809f0381571 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:43 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf.5e7f2a2f-5952-4124-b9e0-5809f0381571 Sep 01 08:35:43 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:43 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27a648f8-46e9-48df-855b-89bd89e46c81 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf.5e7f2a2f-5952-4124-b9e0-5809f0381571" returned: 0 in 0.322s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27a648f8-46e9-48df-855b-89bd89e46c81 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf.5e7f2a2f-5952-4124-b9e0-5809f0381571 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:43 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf.5e7f2a2f-5952-4124-b9e0-5809f0381571 Sep 01 08:35:43 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:43 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-27a648f8-46e9-48df-855b-89bd89e46c81 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf.5e7f2a2f-5952-4124-b9e0-5809f0381571" returned: 0 in 0.252s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:43 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-27a648f8-46e9-48df-855b-89bd89e46c81 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-5e7f2a2f-5952-4124-b9e0-5809f0381571" released by "_delete_snapshot" :: held 1.403s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:43 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-27a648f8-46e9-48df-855b-89bd89e46c81 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf" released by "delete_snapshot" :: held 1.425s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:44 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-27a648f8-46e9-48df-855b-89bd89e46c81 tempest-ProjectMemberTests-966986526 None] Created reservations ['01dbb86e-2cd1-4f32-88e6-a50c45c1f708', '5c328a47-9921-44a4-a52c-f2566a5bfb6c', 'd14e0e11-ad29-4988-9fc4-994f9bb5a0b2', '0aa22e7f-7ca8-418a-8a10-145379a980b6'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:35:44 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-27a648f8-46e9-48df-855b-89bd89e46c81 tempest-ProjectMemberTests-966986526 None] Delete snapshot completed successfully. Sep 01 08:35:44 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-27a648f8-46e9-48df-855b-89bd89e46c81 tempest-ProjectMemberTests-966986526 None] Lock "cinder-5e7f2a2f-5952-4124-b9e0-5809f0381571-delete_snapshot" released by "delete_snapshot" :: held 1.562s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8a2612b2-bc06-45d6-83de-41e58f12a544 tempest-SnapshotDependencyTests-53946882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8a2612b2-bc06-45d6-83de-41e58f12a544 tempest-SnapshotDependencyTests-53946882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:44 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-8a2612b2-bc06-45d6-83de-41e58f12a544 tempest-SnapshotDependencyTests-53946882 None] Creating offline snapshot 46e644ae-80d8-43c9-8bc6-818a4471e100 of volume 451cc584-8ac8-407b-9ba8-da88638050ff {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:35:44 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc328a6-db48-4985-80e3-cf202b3e3acb]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:35:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8a2612b2-bc06-45d6-83de-41e58f12a544 tempest-SnapshotDependencyTests-53946882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:44 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff Sep 01 08:35:44 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:44 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8a2612b2-bc06-45d6-83de-41e58f12a544 tempest-SnapshotDependencyTests-53946882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff" returned: 0 in 0.353s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8a2612b2-bc06-45d6-83de-41e58f12a544 tempest-SnapshotDependencyTests-53946882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff.46e644ae-80d8-43c9-8bc6-818a4471e100 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:44 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff.46e644ae-80d8-43c9-8bc6-818a4471e100 1G Sep 01 08:35:44 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:44 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-81144f7e-05f2-4a51-8977-15a961cad794 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:44 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-81144f7e-05f2-4a51-8977-15a961cad794 tempest-ProjectMemberTests-966986526 None] Lock "cinder-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:44 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-81144f7e-05f2-4a51-8977-15a961cad794 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-quobyte-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:44 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-81144f7e-05f2-4a51-8977-15a961cad794 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf" acquired by "delete_volume" :: waited 0.021s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:44 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[8439677a-c279-4194-9e47-2398f7f2c7e2]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:35:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-81144f7e-05f2-4a51-8977-15a961cad794 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:44 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf Sep 01 08:35:44 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:44 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8a2612b2-bc06-45d6-83de-41e58f12a544 tempest-SnapshotDependencyTests-53946882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff.46e644ae-80d8-43c9-8bc6-818a4471e100 1G" returned: 0 in 0.393s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8a2612b2-bc06-45d6-83de-41e58f12a544 tempest-SnapshotDependencyTests-53946882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-451cc584-8ac8-407b-9ba8-da88638050ff -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff.46e644ae-80d8-43c9-8bc6-818a4471e100 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:44 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-451cc584-8ac8-407b-9ba8-da88638050ff -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff.46e644ae-80d8-43c9-8bc6-818a4471e100 Sep 01 08:35:45 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:45 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-81144f7e-05f2-4a51-8977-15a961cad794 tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf" returned: 0 in 0.429s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-81144f7e-05f2-4a51-8977-15a961cad794 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:45 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf Sep 01 08:35:45 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:45 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8a2612b2-bc06-45d6-83de-41e58f12a544 tempest-SnapshotDependencyTests-53946882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-451cc584-8ac8-407b-9ba8-da88638050ff -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff.46e644ae-80d8-43c9-8bc6-818a4471e100" returned: 0 in 0.314s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:45 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-8a2612b2-bc06-45d6-83de-41e58f12a544 tempest-SnapshotDependencyTests-53946882 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff.46e644ae-80d8-43c9-8bc6-818a4471e100 is being set with open permissions: ugo+rw Sep 01 08:35:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8a2612b2-bc06-45d6-83de-41e58f12a544 tempest-SnapshotDependencyTests-53946882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff.46e644ae-80d8-43c9-8bc6-818a4471e100 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:45 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff.46e644ae-80d8-43c9-8bc6-818a4471e100 Sep 01 08:35:45 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:45 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-81144f7e-05f2-4a51-8977-15a961cad794 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf" returned: 0 in 0.246s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:45 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-81144f7e-05f2-4a51-8977-15a961cad794 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf" released by "delete_volume" :: held 0.733s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:45 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8a2612b2-bc06-45d6-83de-41e58f12a544 tempest-SnapshotDependencyTests-53946882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff.46e644ae-80d8-43c9-8bc6-818a4471e100" returned: 0 in 0.251s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:45 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-81144f7e-05f2-4a51-8977-15a961cad794 tempest-ProjectMemberTests-966986526 None] Created reservations ['6fed2189-742f-4567-9e4d-12f82ff064e4', 'e49b3a34-9327-4528-adaa-34337dc39d95', '57a1f919-6523-4a67-874b-35884baa7b81', '4ddca468-6678-451f-82ab-b6b20fa3ad4e'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:35:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8a2612b2-bc06-45d6-83de-41e58f12a544 tempest-SnapshotDependencyTests-53946882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:45 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff.info Sep 01 08:35:45 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-81144f7e-05f2-4a51-8977-15a961cad794 tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-81144f7e-05f2-4a51-8977-15a961cad794 tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:45 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-81144f7e-05f2-4a51-8977-15a961cad794 tempest-ProjectMemberTests-966986526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:35:45 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-81144f7e-05f2-4a51-8977-15a961cad794 tempest-ProjectMemberTests-966986526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:35:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-81144f7e-05f2-4a51-8977-15a961cad794 tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-81144f7e-05f2-4a51-8977-15a961cad794 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:45 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:35:45 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:45 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8a2612b2-bc06-45d6-83de-41e58f12a544 tempest-SnapshotDependencyTests-53946882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff.info" returned: 0 in 0.269s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:45 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-8a2612b2-bc06-45d6-83de-41e58f12a544 tempest-SnapshotDependencyTests-53946882 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff.info is being set with open permissions: ugo+rw Sep 01 08:35:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8a2612b2-bc06-45d6-83de-41e58f12a544 tempest-SnapshotDependencyTests-53946882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:45 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff.info Sep 01 08:35:45 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:45 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-81144f7e-05f2-4a51-8977-15a961cad794 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.263s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:45 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-81144f7e-05f2-4a51-8977-15a961cad794 tempest-ProjectMemberTests-966986526 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:35:45 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-81144f7e-05f2-4a51-8977-15a961cad794 tempest-ProjectMemberTests-966986526 None] Deleted volume successfully. Sep 01 08:35:45 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-81144f7e-05f2-4a51-8977-15a961cad794 tempest-ProjectMemberTests-966986526 None] Lock "cinder-ab19bb66-925e-4bf9-813a-6a3fe3d7d0bf-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:46 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8a2612b2-bc06-45d6-83de-41e58f12a544 tempest-SnapshotDependencyTests-53946882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff.info" returned: 0 in 0.258s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8a2612b2-bc06-45d6-83de-41e58f12a544 tempest-SnapshotDependencyTests-53946882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.936s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:46 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-8a2612b2-bc06-45d6-83de-41e58f12a544 tempest-SnapshotDependencyTests-53946882 None] Create snapshot completed successfully Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] Flow 'volume_create_manager' (3c369b24-1f0e-4d11-8f80-65cf379a6499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c46756ca-62ea-4375-9472-200b1fc61dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c46756ca-62ea-4375-9472-200b1fc61dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-752651819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e84a3af7-516c-4ecb-bcf0-c5f3c3debefd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ceebf2b634a4548bbd4c6ae9db7ba5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:35:46Z,use_quota=True,user_id='983c5aa98b1a4e0bb6b0bb88c344af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf1f04d-ad03-43d2-8a4d-9dbf9e73ec97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf1f04d-ad03-43d2-8a4d-9dbf9e73ec97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0765046c-ce77-48ad-a7ff-48455b1b40f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0765046c-ce77-48ad-a7ff-48455b1b40f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e84a3af7-516c-4ecb-bcf0-c5f3c3debefd', 'volume_name': 'volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45bf22fd-a69e-4b67-9a98-434d1569d6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45bf22fd-a69e-4b67-9a98-434d1569d6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (658263b2-c275-4734-ac38-4aac3b836811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:46 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] Volume e84a3af7-516c-4ecb-bcf0-c5f3c3debefd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd', 'volume_size': 1} Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-752651819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e84a3af7-516c-4ecb-bcf0-c5f3c3debefd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ceebf2b634a4548bbd4c6ae9db7ba5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:35:46Z,use_quota=True,user_id='983c5aa98b1a4e0bb6b0bb88c344af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] Creating volume e84a3af7-516c-4ecb-bcf0-c5f3c3debefd {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:35:46 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:46 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd 1073741824 Sep 01 08:35:46 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:46 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd 1073741824" returned: 0 in 0.428s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:46 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd Sep 01 08:35:46 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Flow 'volume_create_manager' (a911fecc-c657-480b-a1d3-0356384ead22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c250047-60e5-4d83-8682-f9683934755a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c250047-60e5-4d83-8682-f9683934755a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59b72314-30bc-4ecc-b46f-7252e9557141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d711a6760d1f4058991a452c40a4eb0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=46e644ae-80d8-43c9-8bc6-818a4471e100,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:35:47Z,use_quota=True,user_id='3e9cbd0767aa4eb3a5610fa00043cbef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2601c27d-5e96-4a6e-b9ce-589b26a2bf66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2601c27d-5e96-4a6e-b9ce-589b26a2bf66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af300e1a-e6f5-460e-a47d-e2494e46c2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af300e1a-e6f5-460e-a47d-e2494e46c2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '59b72314-30bc-4ecc-b46f-7252e9557141', 'volume_name': 'volume-59b72314-30bc-4ecc-b46f-7252e9557141', 'volume_size': 1, 'snapshot_id': '46e644ae-80d8-43c9-8bc6-818a4471e100'}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d294a8-d3ec-4e85-b162-431f3b1c4030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d294a8-d3ec-4e85-b162-431f3b1c4030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2131fbaf-450d-43d3-8413-ab820ec7111f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:47 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Volume 59b72314-30bc-4ecc-b46f-7252e9557141: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-59b72314-30bc-4ecc-b46f-7252e9557141', 'volume_size': 1, 'snapshot_id': '46e644ae-80d8-43c9-8bc6-818a4471e100'} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:47 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd" returned: 0 in 0.241s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.143s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Acquiring lock "cinder-quobyte-46e644ae-80d8-43c9-8bc6-818a4471e100-59b72314-30bc-4ecc-b46f-7252e9557141" by "_create_volume_from_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (658263b2-c275-4734-ac38-4aac3b836811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (078c17ae-42c1-4955-8a18-f02a60d5b013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Lock "cinder-quobyte-46e644ae-80d8-43c9-8bc6-818a4471e100-59b72314-30bc-4ecc-b46f-7252e9557141" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Creating volume 59b72314-30bc-4ecc-b46f-7252e9557141 from snapshot 46e644ae-80d8-43c9-8bc6-818a4471e100 {{(pid=86893) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Acquiring lock "cinder-quobyte-59b72314-30bc-4ecc-b46f-7252e9557141" by "_copy_volume_from_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:47 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] Volume volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd (e84a3af7-516c-4ecb-bcf0-c5f3c3debefd): created successfully Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (078c17ae-42c1-4955-8a18-f02a60d5b013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] Flow 'volume_create_manager' (3c369b24-1f0e-4d11-8f80-65cf379a6499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Lock "cinder-quobyte-59b72314-30bc-4ecc-b46f-7252e9557141" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] snapshot: 46e644ae-80d8-43c9-8bc6-818a4471e100, volume: 59b72314-30bc-4ecc-b46f-7252e9557141, {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 08:35:47 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-3ddad0f5-65ef-435f-83f7-97494f747d9a tempest-ProjectMemberTests-966986526 None] Created volume successfully. Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[951473cd-6687-4f59-b70a-0521b3828cc3]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff.46e644ae-80d8-43c9-8bc6-818a4471e100 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:47 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff.46e644ae-80d8-43c9-8bc6-818a4471e100 Sep 01 08:35:47 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-64bed311-87eb-4f22-a111-2d88684e5000 tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:47 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff.46e644ae-80d8-43c9-8bc6-818a4471e100" returned: 0 in 0.362s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-451cc584-8ac8-407b-9ba8-da88638050ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b011e786-1ca3-4e48-b9d3-2bc576b1adf9]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:47 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff Sep 01 08:35:47 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:47 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff" returned: 0 in 0.350s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 08:35:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Creating direct copy from snapshot {{(pid=86893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 08:35:48 devstack cinder-volume[86893]: DEBUG cinder.utils [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Path /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-59b72314-30bc-4ecc-b46f-7252e9557141 not found in is_blk_device check {{(pid=86893) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 08:35:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-59b72314-30bc-4ecc-b46f-7252e9557141 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:48 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-59b72314-30bc-4ecc-b46f-7252e9557141 Sep 01 08:35:48 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:52 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-59b72314-30bc-4ecc-b46f-7252e9557141" returned: 0 in 4.223s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:52 devstack cinder-volume[86893]: DEBUG cinder.image.image_utils [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Image conversion details: src /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff, size 1024.00 MB, duration 4.22 sec, destination /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-59b72314-30bc-4ecc-b46f-7252e9557141 {{(pid=86893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 08:35:52 devstack cinder-volume[86893]: INFO cinder.image.image_utils [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Converted 1024.00 MB image at 242.38 MB/s Sep 01 08:35:52 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-59b72314-30bc-4ecc-b46f-7252e9557141 is being set with open permissions: ugo+rw Sep 01 08:35:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-59b72314-30bc-4ecc-b46f-7252e9557141 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:52 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-59b72314-30bc-4ecc-b46f-7252e9557141 Sep 01 08:35:52 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:52 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-59b72314-30bc-4ecc-b46f-7252e9557141" returned: 0 in 0.245s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:52 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Lock "cinder-quobyte-59b72314-30bc-4ecc-b46f-7252e9557141" released by "_copy_volume_from_snapshot" :: held 5.257s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:52 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Lock "cinder-quobyte-46e644ae-80d8-43c9-8bc6-818a4471e100-59b72314-30bc-4ecc-b46f-7252e9557141" released by "_create_volume_from_snapshot" :: held 5.325s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.356s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-64bed311-87eb-4f22-a111-2d88684e5000 tempest-ProjectMemberTests-966986526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.993s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-64bed311-87eb-4f22-a111-2d88684e5000 tempest-ProjectMemberTests-966986526 None] Creating offline snapshot 5439bd8d-f208-4bfd-b3f3-8c8fd520e808 of volume e84a3af7-516c-4ecb-bcf0-c5f3c3debefd {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:35:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2131fbaf-450d-43d3-8413-ab820ec7111f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59b72314-30bc-4ecc-b46f-7252e9557141', 'volume_size': 1, 'snapshot_id': '46e644ae-80d8-43c9-8bc6-818a4471e100'}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397fdffd-30f9-46c7-b74d-871237c48073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:52 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[678dd07a-d6c3-4e16-a006-7d2ed03fb6e8]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:35:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-64bed311-87eb-4f22-a111-2d88684e5000 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:52 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Volume volume-59b72314-30bc-4ecc-b46f-7252e9557141 (59b72314-30bc-4ecc-b46f-7252e9557141): created successfully Sep 01 08:35:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397fdffd-30f9-46c7-b74d-871237c48073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:52 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Flow 'volume_create_manager' (a911fecc-c657-480b-a1d3-0356384ead22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:35:52 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-7118e310-746e-408c-a924-e74742271786 tempest-SnapshotDependencyTests-53946882 None] Created volume successfully. Sep 01 08:35:52 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd Sep 01 08:35:52 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:52 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-64bed311-87eb-4f22-a111-2d88684e5000 tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd" returned: 0 in 0.357s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-64bed311-87eb-4f22-a111-2d88684e5000 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd.5439bd8d-f208-4bfd-b3f3-8c8fd520e808 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:52 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd.5439bd8d-f208-4bfd-b3f3-8c8fd520e808 1G Sep 01 08:35:52 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:53 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-64bed311-87eb-4f22-a111-2d88684e5000 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd.5439bd8d-f208-4bfd-b3f3-8c8fd520e808 1G" returned: 0 in 0.374s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-64bed311-87eb-4f22-a111-2d88684e5000 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd.5439bd8d-f208-4bfd-b3f3-8c8fd520e808 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:53 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd.5439bd8d-f208-4bfd-b3f3-8c8fd520e808 Sep 01 08:35:53 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:53 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e1f42c84-8c2a-42e3-8b9c-10caa34de887 tempest-SnapshotDependencyTests-53946882 None] Acquiring lock "cinder-46e644ae-80d8-43c9-8bc6-818a4471e100-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:53 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e1f42c84-8c2a-42e3-8b9c-10caa34de887 tempest-SnapshotDependencyTests-53946882 None] Lock "cinder-46e644ae-80d8-43c9-8bc6-818a4471e100-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:53 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e1f42c84-8c2a-42e3-8b9c-10caa34de887 tempest-SnapshotDependencyTests-53946882 None] Acquiring lock "cinder-quobyte-451cc584-8ac8-407b-9ba8-da88638050ff" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:53 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e1f42c84-8c2a-42e3-8b9c-10caa34de887 tempest-SnapshotDependencyTests-53946882 None] Lock "cinder-quobyte-451cc584-8ac8-407b-9ba8-da88638050ff" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:53 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e1f42c84-8c2a-42e3-8b9c-10caa34de887 tempest-SnapshotDependencyTests-53946882 None] Acquiring lock "cinder-quobyte-46e644ae-80d8-43c9-8bc6-818a4471e100" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:53 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e1f42c84-8c2a-42e3-8b9c-10caa34de887 tempest-SnapshotDependencyTests-53946882 None] Lock "cinder-quobyte-46e644ae-80d8-43c9-8bc6-818a4471e100" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:53 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-e1f42c84-8c2a-42e3-8b9c-10caa34de887 tempest-SnapshotDependencyTests-53946882 None] Deleting offline snapshot 46e644ae-80d8-43c9-8bc6-818a4471e100 of volume 451cc584-8ac8-407b-9ba8-da88638050ff {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:35:53 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-e1f42c84-8c2a-42e3-8b9c-10caa34de887 tempest-SnapshotDependencyTests-53946882 None] snapshot_file for this snap is: volume-451cc584-8ac8-407b-9ba8-da88638050ff.46e644ae-80d8-43c9-8bc6-818a4471e100 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:35:53 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[666469f3-56f7-42a5-b3ea-d74664f299bd]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:35:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e1f42c84-8c2a-42e3-8b9c-10caa34de887 tempest-SnapshotDependencyTests-53946882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff.46e644ae-80d8-43c9-8bc6-818a4471e100 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:53 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-64bed311-87eb-4f22-a111-2d88684e5000 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd.5439bd8d-f208-4bfd-b3f3-8c8fd520e808" returned: 0 in 0.304s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:53 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-64bed311-87eb-4f22-a111-2d88684e5000 tempest-ProjectMemberTests-966986526 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd.5439bd8d-f208-4bfd-b3f3-8c8fd520e808 is being set with open permissions: ugo+rw Sep 01 08:35:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-64bed311-87eb-4f22-a111-2d88684e5000 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd.5439bd8d-f208-4bfd-b3f3-8c8fd520e808 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:53 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd.5439bd8d-f208-4bfd-b3f3-8c8fd520e808 Sep 01 08:35:53 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:53 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff.46e644ae-80d8-43c9-8bc6-818a4471e100 Sep 01 08:35:53 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:53 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-64bed311-87eb-4f22-a111-2d88684e5000 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd.5439bd8d-f208-4bfd-b3f3-8c8fd520e808" returned: 0 in 0.251s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-64bed311-87eb-4f22-a111-2d88684e5000 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:53 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd.info Sep 01 08:35:53 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:53 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e1f42c84-8c2a-42e3-8b9c-10caa34de887 tempest-SnapshotDependencyTests-53946882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff.46e644ae-80d8-43c9-8bc6-818a4471e100" returned: 0 in 0.361s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:53 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-e1f42c84-8c2a-42e3-8b9c-10caa34de887 tempest-SnapshotDependencyTests-53946882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-451cc584-8ac8-407b-9ba8-da88638050ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:35:53 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5cb7a6-247b-4964-9fbe-90d86e3ed588]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:35:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e1f42c84-8c2a-42e3-8b9c-10caa34de887 tempest-SnapshotDependencyTests-53946882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:54 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff Sep 01 08:35:54 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:54 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-64bed311-87eb-4f22-a111-2d88684e5000 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd.info" returned: 0 in 0.252s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:54 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-64bed311-87eb-4f22-a111-2d88684e5000 tempest-ProjectMemberTests-966986526 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd.info is being set with open permissions: ugo+rw Sep 01 08:35:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-64bed311-87eb-4f22-a111-2d88684e5000 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:54 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd.info Sep 01 08:35:54 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:54 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-64bed311-87eb-4f22-a111-2d88684e5000 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd.info" returned: 0 in 0.250s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-64bed311-87eb-4f22-a111-2d88684e5000 tempest-ProjectMemberTests-966986526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.877s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:54 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-64bed311-87eb-4f22-a111-2d88684e5000 tempest-ProjectMemberTests-966986526 None] Create snapshot completed successfully Sep 01 08:35:54 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e1f42c84-8c2a-42e3-8b9c-10caa34de887 tempest-SnapshotDependencyTests-53946882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff" returned: 0 in 0.543s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e1f42c84-8c2a-42e3-8b9c-10caa34de887 tempest-SnapshotDependencyTests-53946882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff.46e644ae-80d8-43c9-8bc6-818a4471e100 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:54 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff.46e644ae-80d8-43c9-8bc6-818a4471e100 Sep 01 08:35:54 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:54 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e1f42c84-8c2a-42e3-8b9c-10caa34de887 tempest-SnapshotDependencyTests-53946882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff.46e644ae-80d8-43c9-8bc6-818a4471e100" returned: 0 in 0.325s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e1f42c84-8c2a-42e3-8b9c-10caa34de887 tempest-SnapshotDependencyTests-53946882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff.46e644ae-80d8-43c9-8bc6-818a4471e100 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:54 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff.46e644ae-80d8-43c9-8bc6-818a4471e100 Sep 01 08:35:54 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:54 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2067fbae-53a1-416c-97ba-b64cbd40d834 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-5439bd8d-f208-4bfd-b3f3-8c8fd520e808-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:54 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2067fbae-53a1-416c-97ba-b64cbd40d834 tempest-ProjectMemberTests-966986526 None] Lock "cinder-5439bd8d-f208-4bfd-b3f3-8c8fd520e808-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:54 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2067fbae-53a1-416c-97ba-b64cbd40d834 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-quobyte-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:54 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2067fbae-53a1-416c-97ba-b64cbd40d834 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:54 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2067fbae-53a1-416c-97ba-b64cbd40d834 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-quobyte-5439bd8d-f208-4bfd-b3f3-8c8fd520e808" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:54 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2067fbae-53a1-416c-97ba-b64cbd40d834 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-5439bd8d-f208-4bfd-b3f3-8c8fd520e808" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-2067fbae-53a1-416c-97ba-b64cbd40d834 tempest-ProjectMemberTests-966986526 None] Deleting offline snapshot 5439bd8d-f208-4bfd-b3f3-8c8fd520e808 of volume e84a3af7-516c-4ecb-bcf0-c5f3c3debefd {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:35:55 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-2067fbae-53a1-416c-97ba-b64cbd40d834 tempest-ProjectMemberTests-966986526 None] snapshot_file for this snap is: volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd.5439bd8d-f208-4bfd-b3f3-8c8fd520e808 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:35:55 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[67179e8d-c23c-46b3-9770-348a9f4af385]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:35:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2067fbae-53a1-416c-97ba-b64cbd40d834 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd.5439bd8d-f208-4bfd-b3f3-8c8fd520e808 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:55 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e1f42c84-8c2a-42e3-8b9c-10caa34de887 tempest-SnapshotDependencyTests-53946882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff.46e644ae-80d8-43c9-8bc6-818a4471e100" returned: 0 in 0.259s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e1f42c84-8c2a-42e3-8b9c-10caa34de887 tempest-SnapshotDependencyTests-53946882 None] Lock "cinder-quobyte-46e644ae-80d8-43c9-8bc6-818a4471e100" released by "_delete_snapshot" :: held 1.581s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e1f42c84-8c2a-42e3-8b9c-10caa34de887 tempest-SnapshotDependencyTests-53946882 None] Lock "cinder-quobyte-451cc584-8ac8-407b-9ba8-da88638050ff" released by "delete_snapshot" :: held 1.609s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:55 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd.5439bd8d-f208-4bfd-b3f3-8c8fd520e808 Sep 01 08:35:55 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:55 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-e1f42c84-8c2a-42e3-8b9c-10caa34de887 tempest-SnapshotDependencyTests-53946882 None] Created reservations ['aaae6f7e-b7aa-412e-ba86-a25ce89507bf', '8366ce45-dfe2-4102-b610-11bb380b438f', 'dc1be46d-d37b-4ef5-adeb-70b053636ba1', '83f15f0b-b978-4928-88e1-cbaf584f1388'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:35:55 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-e1f42c84-8c2a-42e3-8b9c-10caa34de887 tempest-SnapshotDependencyTests-53946882 None] Delete snapshot completed successfully. Sep 01 08:35:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e1f42c84-8c2a-42e3-8b9c-10caa34de887 tempest-SnapshotDependencyTests-53946882 None] Lock "cinder-46e644ae-80d8-43c9-8bc6-818a4471e100-delete_snapshot" released by "delete_snapshot" :: held 1.748s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:55 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2067fbae-53a1-416c-97ba-b64cbd40d834 tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd.5439bd8d-f208-4bfd-b3f3-8c8fd520e808" returned: 0 in 0.365s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:55 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-2067fbae-53a1-416c-97ba-b64cbd40d834 tempest-ProjectMemberTests-966986526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:35:55 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[0031e924-8c58-42ff-af00-9014a628a3e1]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:35:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2067fbae-53a1-416c-97ba-b64cbd40d834 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:55 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd Sep 01 08:35:55 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a147db96-37b4-4852-a4b0-09a7ddd5478e tempest-SnapshotDependencyTests-53946882 None] Acquiring lock "cinder-451cc584-8ac8-407b-9ba8-da88638050ff-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a147db96-37b4-4852-a4b0-09a7ddd5478e tempest-SnapshotDependencyTests-53946882 None] Lock "cinder-451cc584-8ac8-407b-9ba8-da88638050ff-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a147db96-37b4-4852-a4b0-09a7ddd5478e tempest-SnapshotDependencyTests-53946882 None] Acquiring lock "cinder-quobyte-451cc584-8ac8-407b-9ba8-da88638050ff" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:55 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a147db96-37b4-4852-a4b0-09a7ddd5478e tempest-SnapshotDependencyTests-53946882 None] Lock "cinder-quobyte-451cc584-8ac8-407b-9ba8-da88638050ff" acquired by "delete_volume" :: waited 0.023s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:55 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f962878-0bfb-48ee-874c-8efe0bbece3e]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:35:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a147db96-37b4-4852-a4b0-09a7ddd5478e tempest-SnapshotDependencyTests-53946882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:55 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2067fbae-53a1-416c-97ba-b64cbd40d834 tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd" returned: 0 in 0.379s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2067fbae-53a1-416c-97ba-b64cbd40d834 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd.5439bd8d-f208-4bfd-b3f3-8c8fd520e808 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:55 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd.5439bd8d-f208-4bfd-b3f3-8c8fd520e808 Sep 01 08:35:55 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:55 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff Sep 01 08:35:55 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:56 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a147db96-37b4-4852-a4b0-09a7ddd5478e tempest-SnapshotDependencyTests-53946882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff" returned: 0 in 0.365s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a147db96-37b4-4852-a4b0-09a7ddd5478e tempest-SnapshotDependencyTests-53946882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:56 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2067fbae-53a1-416c-97ba-b64cbd40d834 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd.5439bd8d-f208-4bfd-b3f3-8c8fd520e808" returned: 0 in 0.358s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2067fbae-53a1-416c-97ba-b64cbd40d834 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd.5439bd8d-f208-4bfd-b3f3-8c8fd520e808 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:56 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff Sep 01 08:35:56 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:56 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd.5439bd8d-f208-4bfd-b3f3-8c8fd520e808 Sep 01 08:35:56 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:56 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a147db96-37b4-4852-a4b0-09a7ddd5478e tempest-SnapshotDependencyTests-53946882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-451cc584-8ac8-407b-9ba8-da88638050ff" returned: 0 in 0.259s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:56 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-2067fbae-53a1-416c-97ba-b64cbd40d834 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd.5439bd8d-f208-4bfd-b3f3-8c8fd520e808" returned: 0 in 0.258s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a147db96-37b4-4852-a4b0-09a7ddd5478e tempest-SnapshotDependencyTests-53946882 None] Lock "cinder-quobyte-451cc584-8ac8-407b-9ba8-da88638050ff" released by "delete_volume" :: held 0.697s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2067fbae-53a1-416c-97ba-b64cbd40d834 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-5439bd8d-f208-4bfd-b3f3-8c8fd520e808" released by "_delete_snapshot" :: held 1.445s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2067fbae-53a1-416c-97ba-b64cbd40d834 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd" released by "delete_snapshot" :: held 1.470s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:56 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-a147db96-37b4-4852-a4b0-09a7ddd5478e tempest-SnapshotDependencyTests-53946882 None] Created reservations ['b5a3c2b7-3c94-458a-8a86-30264080aeb5', '5ae7fb93-85d1-4c5f-8031-10f3454be4b4', '27155dc4-d6a3-441d-abc1-05378ef52dc1', '97bc8092-8f7b-45e4-8a94-9e1af0f679f5'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:35:56 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-2067fbae-53a1-416c-97ba-b64cbd40d834 tempest-ProjectMemberTests-966986526 None] Created reservations ['05d8a5c5-51af-4174-bfd4-98ae3e067e62', '34c915dc-cac0-4afe-aed5-5195f25203f2', '9271b89b-d9c0-4440-b66f-69df545b7ec8', 'b8f6b2e5-7f9e-43e1-a71e-7ee7742e7f48'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:35:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a147db96-37b4-4852-a4b0-09a7ddd5478e tempest-SnapshotDependencyTests-53946882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a147db96-37b4-4852-a4b0-09a7ddd5478e tempest-SnapshotDependencyTests-53946882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:56 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a147db96-37b4-4852-a4b0-09a7ddd5478e tempest-SnapshotDependencyTests-53946882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:35:56 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a147db96-37b4-4852-a4b0-09a7ddd5478e tempest-SnapshotDependencyTests-53946882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:35:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a147db96-37b4-4852-a4b0-09a7ddd5478e tempest-SnapshotDependencyTests-53946882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a147db96-37b4-4852-a4b0-09a7ddd5478e tempest-SnapshotDependencyTests-53946882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:56 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:35:56 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:56 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-2067fbae-53a1-416c-97ba-b64cbd40d834 tempest-ProjectMemberTests-966986526 None] Delete snapshot completed successfully. Sep 01 08:35:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-2067fbae-53a1-416c-97ba-b64cbd40d834 tempest-ProjectMemberTests-966986526 None] Lock "cinder-5439bd8d-f208-4bfd-b3f3-8c8fd520e808-delete_snapshot" released by "delete_snapshot" :: held 1.683s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-646112b5-92d5-4df1-a2d7-b1f5237c7a1c tempest-SnapshotDependencyTests-53946882 None] Acquiring lock "cinder-59b72314-30bc-4ecc-b46f-7252e9557141-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-646112b5-92d5-4df1-a2d7-b1f5237c7a1c tempest-SnapshotDependencyTests-53946882 None] Lock "cinder-59b72314-30bc-4ecc-b46f-7252e9557141-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:56 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a147db96-37b4-4852-a4b0-09a7ddd5478e tempest-SnapshotDependencyTests-53946882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.284s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:56 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-a147db96-37b4-4852-a4b0-09a7ddd5478e tempest-SnapshotDependencyTests-53946882 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:35:56 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-a147db96-37b4-4852-a4b0-09a7ddd5478e tempest-SnapshotDependencyTests-53946882 None] Deleted volume successfully. Sep 01 08:35:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a147db96-37b4-4852-a4b0-09a7ddd5478e tempest-SnapshotDependencyTests-53946882 None] Lock "cinder-451cc584-8ac8-407b-9ba8-da88638050ff-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-646112b5-92d5-4df1-a2d7-b1f5237c7a1c tempest-SnapshotDependencyTests-53946882 None] Acquiring lock "cinder-quobyte-59b72314-30bc-4ecc-b46f-7252e9557141" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-646112b5-92d5-4df1-a2d7-b1f5237c7a1c tempest-SnapshotDependencyTests-53946882 None] Lock "cinder-quobyte-59b72314-30bc-4ecc-b46f-7252e9557141" acquired by "delete_volume" :: waited 0.015s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:56 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[780cbb96-4f5c-4cd7-aa6a-2b8ff254c1bf]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:35:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-646112b5-92d5-4df1-a2d7-b1f5237c7a1c tempest-SnapshotDependencyTests-53946882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-59b72314-30bc-4ecc-b46f-7252e9557141 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:57 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-59b72314-30bc-4ecc-b46f-7252e9557141 Sep 01 08:35:57 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e7f25127-be68-42bf-b9f4-1d057a97594b tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e7f25127-be68-42bf-b9f4-1d057a97594b tempest-ProjectMemberTests-966986526 None] Lock "cinder-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e7f25127-be68-42bf-b9f4-1d057a97594b tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-quobyte-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:35:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e7f25127-be68-42bf-b9f4-1d057a97594b tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd" acquired by "delete_volume" :: waited 0.025s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:35:57 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[5286d4e7-593b-4ee6-8c93-84a725b73903]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:35:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e7f25127-be68-42bf-b9f4-1d057a97594b tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:57 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-646112b5-92d5-4df1-a2d7-b1f5237c7a1c tempest-SnapshotDependencyTests-53946882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-59b72314-30bc-4ecc-b46f-7252e9557141" returned: 0 in 0.380s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-646112b5-92d5-4df1-a2d7-b1f5237c7a1c tempest-SnapshotDependencyTests-53946882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-59b72314-30bc-4ecc-b46f-7252e9557141 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:57 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-59b72314-30bc-4ecc-b46f-7252e9557141 Sep 01 08:35:57 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:57 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd Sep 01 08:35:57 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:57 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-646112b5-92d5-4df1-a2d7-b1f5237c7a1c tempest-SnapshotDependencyTests-53946882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-59b72314-30bc-4ecc-b46f-7252e9557141" returned: 0 in 0.258s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-646112b5-92d5-4df1-a2d7-b1f5237c7a1c tempest-SnapshotDependencyTests-53946882 None] Lock "cinder-quobyte-59b72314-30bc-4ecc-b46f-7252e9557141" released by "delete_volume" :: held 0.680s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:57 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e7f25127-be68-42bf-b9f4-1d057a97594b tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd" returned: 0 in 0.382s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e7f25127-be68-42bf-b9f4-1d057a97594b tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:57 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd Sep 01 08:35:57 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:57 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-646112b5-92d5-4df1-a2d7-b1f5237c7a1c tempest-SnapshotDependencyTests-53946882 None] Created reservations ['fc6fa818-6870-41f2-aa66-a10ef5c88029', '6e8a8d05-7be8-45ff-8846-2b7f6657959c', 'aabad9a3-d685-4b68-a5e2-4b482312e424', 'd2966004-150e-463a-a33b-b470a46a81f2'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:35:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-646112b5-92d5-4df1-a2d7-b1f5237c7a1c tempest-SnapshotDependencyTests-53946882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-646112b5-92d5-4df1-a2d7-b1f5237c7a1c tempest-SnapshotDependencyTests-53946882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-646112b5-92d5-4df1-a2d7-b1f5237c7a1c tempest-SnapshotDependencyTests-53946882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:35:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-646112b5-92d5-4df1-a2d7-b1f5237c7a1c tempest-SnapshotDependencyTests-53946882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:35:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-646112b5-92d5-4df1-a2d7-b1f5237c7a1c tempest-SnapshotDependencyTests-53946882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-646112b5-92d5-4df1-a2d7-b1f5237c7a1c tempest-SnapshotDependencyTests-53946882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:57 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:35:57 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:57 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e7f25127-be68-42bf-b9f4-1d057a97594b tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd" returned: 0 in 0.268s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:57 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e7f25127-be68-42bf-b9f4-1d057a97594b tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd" released by "delete_volume" :: held 0.709s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:57 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-e7f25127-be68-42bf-b9f4-1d057a97594b tempest-ProjectMemberTests-966986526 None] Created reservations ['83b6f676-e560-4798-92d5-99d990f51797', '48c397ef-941a-421a-bbea-7a5cdd42ce73', 'a1746bb1-a286-46b1-8d54-34511799ad0a', '57fa4580-8fc9-454f-aaa6-e8b6de4e6210'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e7f25127-be68-42bf-b9f4-1d057a97594b tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e7f25127-be68-42bf-b9f4-1d057a97594b tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e7f25127-be68-42bf-b9f4-1d057a97594b tempest-ProjectMemberTests-966986526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:35:58 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-e7f25127-be68-42bf-b9f4-1d057a97594b tempest-ProjectMemberTests-966986526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-e7f25127-be68-42bf-b9f4-1d057a97594b tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e7f25127-be68-42bf-b9f4-1d057a97594b tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-646112b5-92d5-4df1-a2d7-b1f5237c7a1c tempest-SnapshotDependencyTests-53946882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.296s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-646112b5-92d5-4df1-a2d7-b1f5237c7a1c tempest-SnapshotDependencyTests-53946882 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:35:58 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-646112b5-92d5-4df1-a2d7-b1f5237c7a1c tempest-SnapshotDependencyTests-53946882 None] Deleted volume successfully. Sep 01 08:35:58 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:35:58 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-646112b5-92d5-4df1-a2d7-b1f5237c7a1c tempest-SnapshotDependencyTests-53946882 None] Lock "cinder-59b72314-30bc-4ecc-b46f-7252e9557141-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:58 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e7f25127-be68-42bf-b9f4-1d057a97594b tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.254s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-e7f25127-be68-42bf-b9f4-1d057a97594b tempest-ProjectMemberTests-966986526 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:35:58 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-e7f25127-be68-42bf-b9f4-1d057a97594b tempest-ProjectMemberTests-966986526 None] Deleted volume successfully. Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e7f25127-be68-42bf-b9f4-1d057a97594b tempest-ProjectMemberTests-966986526 None] Lock "cinder-e84a3af7-516c-4ecb-bcf0-c5f3c3debefd-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] Flow 'volume_create_manager' (fa67021a-d2eb-46c0-a86f-5ec34cdd85d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f247fd-e8ad-419b-9bb1-c4edb14b2ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f247fd-e8ad-419b-9bb1-c4edb14b2ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-243242489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe646923-75c2-467c-b885-c44ce0b4290b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ceebf2b634a4548bbd4c6ae9db7ba5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:35:59Z,use_quota=True,user_id='983c5aa98b1a4e0bb6b0bb88c344af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f83041ee-a69c-441e-85a0-068c555225ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f83041ee-a69c-441e-85a0-068c555225ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c5d3031-0264-4de0-8119-6c598e7f1280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c5d3031-0264-4de0-8119-6c598e7f1280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe646923-75c2-467c-b885-c44ce0b4290b', 'volume_name': 'volume-fe646923-75c2-467c-b885-c44ce0b4290b', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ba491a-30c3-4162-bad0-d56fab9a7d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ba491a-30c3-4162-bad0-d56fab9a7d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778155b9-8ce5-4667-bae6-62400218ab76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:58 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] Volume fe646923-75c2-467c-b885-c44ce0b4290b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe646923-75c2-467c-b885-c44ce0b4290b', 'volume_size': 1} Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-243242489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe646923-75c2-467c-b885-c44ce0b4290b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ceebf2b634a4548bbd4c6ae9db7ba5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:35:59Z,use_quota=True,user_id='983c5aa98b1a4e0bb6b0bb88c344af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] Creating volume fe646923-75c2-467c-b885-c44ce0b4290b {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:35:58 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:35:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:58 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b 1073741824 Sep 01 08:35:58 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:59 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b 1073741824" returned: 0 in 0.431s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:35:59 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b Sep 01 08:35:59 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:35:59 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Sep 01 08:35:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b" returned: 0 in 0.285s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:35:59 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:35:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:35:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778155b9-8ce5-4667-bae6-62400218ab76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe646923-75c2-467c-b885-c44ce0b4290b', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7555a72-142a-483c-ab4b-3b6ed66a3fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:35:59 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] Volume volume-fe646923-75c2-467c-b885-c44ce0b4290b (fe646923-75c2-467c-b885-c44ce0b4290b): created successfully Sep 01 08:35:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7555a72-142a-483c-ab4b-3b6ed66a3fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:35:59 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] Flow 'volume_create_manager' (fa67021a-d2eb-46c0-a86f-5ec34cdd85d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:35:59 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-726cbc3c-0fce-4b77-a60c-8fb1406b9c5f tempest-ProjectMemberTests-966986526 None] Created volume successfully. Sep 01 08:36:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-26fd4241-96d5-486a-9ac9-f6913b14151e tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:36:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-26fd4241-96d5-486a-9ac9-f6913b14151e tempest-ProjectMemberTests-966986526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:36:00 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-26fd4241-96d5-486a-9ac9-f6913b14151e tempest-ProjectMemberTests-966986526 None] Creating offline snapshot 0dfb6b54-cc15-4935-b118-e811dc53d916 of volume fe646923-75c2-467c-b885-c44ce0b4290b {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:36:00 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd40e880-f2dc-459f-95a6-66c9f30f4040]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-26fd4241-96d5-486a-9ac9-f6913b14151e tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:01 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b Sep 01 08:36:01 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:01 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-26fd4241-96d5-486a-9ac9-f6913b14151e tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b" returned: 0 in 0.374s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-26fd4241-96d5-486a-9ac9-f6913b14151e tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b.0dfb6b54-cc15-4935-b118-e811dc53d916 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:01 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b.0dfb6b54-cc15-4935-b118-e811dc53d916 1G Sep 01 08:36:01 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:01 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-26fd4241-96d5-486a-9ac9-f6913b14151e tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b.0dfb6b54-cc15-4935-b118-e811dc53d916 1G" returned: 0 in 0.430s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-26fd4241-96d5-486a-9ac9-f6913b14151e tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe646923-75c2-467c-b885-c44ce0b4290b -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b.0dfb6b54-cc15-4935-b118-e811dc53d916 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:01 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe646923-75c2-467c-b885-c44ce0b4290b -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b.0dfb6b54-cc15-4935-b118-e811dc53d916 Sep 01 08:36:01 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:02 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-26fd4241-96d5-486a-9ac9-f6913b14151e tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe646923-75c2-467c-b885-c44ce0b4290b -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b.0dfb6b54-cc15-4935-b118-e811dc53d916" returned: 0 in 0.303s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:02 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-26fd4241-96d5-486a-9ac9-f6913b14151e tempest-ProjectMemberTests-966986526 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b.0dfb6b54-cc15-4935-b118-e811dc53d916 is being set with open permissions: ugo+rw Sep 01 08:36:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-26fd4241-96d5-486a-9ac9-f6913b14151e tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b.0dfb6b54-cc15-4935-b118-e811dc53d916 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:02 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b.0dfb6b54-cc15-4935-b118-e811dc53d916 Sep 01 08:36:02 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:02 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-26fd4241-96d5-486a-9ac9-f6913b14151e tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b.0dfb6b54-cc15-4935-b118-e811dc53d916" returned: 0 in 0.290s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-26fd4241-96d5-486a-9ac9-f6913b14151e tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:02 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b.info Sep 01 08:36:02 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:02 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-26fd4241-96d5-486a-9ac9-f6913b14151e tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b.info" returned: 0 in 0.256s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:02 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-26fd4241-96d5-486a-9ac9-f6913b14151e tempest-ProjectMemberTests-966986526 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b.info is being set with open permissions: ugo+rw Sep 01 08:36:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-26fd4241-96d5-486a-9ac9-f6913b14151e tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:02 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b.info Sep 01 08:36:02 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:02 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-26fd4241-96d5-486a-9ac9-f6913b14151e tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b.info" returned: 0 in 0.265s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-26fd4241-96d5-486a-9ac9-f6913b14151e tempest-ProjectMemberTests-966986526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.012s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:36:03 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-26fd4241-96d5-486a-9ac9-f6913b14151e tempest-ProjectMemberTests-966986526 None] Create snapshot completed successfully Sep 01 08:36:04 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e8025cb1-0563-4d17-917f-83545bd31f49 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-0dfb6b54-cc15-4935-b118-e811dc53d916-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:04 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e8025cb1-0563-4d17-917f-83545bd31f49 tempest-ProjectMemberTests-966986526 None] Lock "cinder-0dfb6b54-cc15-4935-b118-e811dc53d916-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:04 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e8025cb1-0563-4d17-917f-83545bd31f49 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-quobyte-fe646923-75c2-467c-b885-c44ce0b4290b" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:04 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e8025cb1-0563-4d17-917f-83545bd31f49 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-fe646923-75c2-467c-b885-c44ce0b4290b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:04 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e8025cb1-0563-4d17-917f-83545bd31f49 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-quobyte-0dfb6b54-cc15-4935-b118-e811dc53d916" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:04 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e8025cb1-0563-4d17-917f-83545bd31f49 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-0dfb6b54-cc15-4935-b118-e811dc53d916" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:04 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-e8025cb1-0563-4d17-917f-83545bd31f49 tempest-ProjectMemberTests-966986526 None] Deleting offline snapshot 0dfb6b54-cc15-4935-b118-e811dc53d916 of volume fe646923-75c2-467c-b885-c44ce0b4290b {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:36:04 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-e8025cb1-0563-4d17-917f-83545bd31f49 tempest-ProjectMemberTests-966986526 None] snapshot_file for this snap is: volume-fe646923-75c2-467c-b885-c44ce0b4290b.0dfb6b54-cc15-4935-b118-e811dc53d916 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:36:04 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[c768ad3d-3fa1-4c26-9f2e-815d1af66326]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e8025cb1-0563-4d17-917f-83545bd31f49 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b.0dfb6b54-cc15-4935-b118-e811dc53d916 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:04 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b.0dfb6b54-cc15-4935-b118-e811dc53d916 Sep 01 08:36:04 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:04 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e8025cb1-0563-4d17-917f-83545bd31f49 tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b.0dfb6b54-cc15-4935-b118-e811dc53d916" returned: 0 in 0.397s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:04 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-e8025cb1-0563-4d17-917f-83545bd31f49 tempest-ProjectMemberTests-966986526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe646923-75c2-467c-b885-c44ce0b4290b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:36:04 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa7f696-849d-4216-aba5-f6f1468c1cca]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e8025cb1-0563-4d17-917f-83545bd31f49 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:04 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b Sep 01 08:36:04 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:05 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e8025cb1-0563-4d17-917f-83545bd31f49 tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b" returned: 0 in 0.357s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e8025cb1-0563-4d17-917f-83545bd31f49 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b.0dfb6b54-cc15-4935-b118-e811dc53d916 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:05 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b.0dfb6b54-cc15-4935-b118-e811dc53d916 Sep 01 08:36:05 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:05 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e8025cb1-0563-4d17-917f-83545bd31f49 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b.0dfb6b54-cc15-4935-b118-e811dc53d916" returned: 0 in 0.352s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e8025cb1-0563-4d17-917f-83545bd31f49 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b.0dfb6b54-cc15-4935-b118-e811dc53d916 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:05 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b.0dfb6b54-cc15-4935-b118-e811dc53d916 Sep 01 08:36:05 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:05 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-e8025cb1-0563-4d17-917f-83545bd31f49 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b.0dfb6b54-cc15-4935-b118-e811dc53d916" returned: 0 in 0.272s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:05 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e8025cb1-0563-4d17-917f-83545bd31f49 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-0dfb6b54-cc15-4935-b118-e811dc53d916" released by "_delete_snapshot" :: held 1.485s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:05 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e8025cb1-0563-4d17-917f-83545bd31f49 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-fe646923-75c2-467c-b885-c44ce0b4290b" released by "delete_snapshot" :: held 1.515s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:05 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-e8025cb1-0563-4d17-917f-83545bd31f49 tempest-ProjectMemberTests-966986526 None] Created reservations ['de66353b-9b7b-48d6-bfcf-0bae97ab5927', '0a73c4b9-e832-4558-8aba-572c6d3a3b59', '418ffc64-54c2-48a9-a90d-e84ec5a453d5', '9df590dc-430a-42ae-91fb-e80de4d0a422'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:36:05 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-e8025cb1-0563-4d17-917f-83545bd31f49 tempest-ProjectMemberTests-966986526 None] Delete snapshot completed successfully. Sep 01 08:36:05 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-e8025cb1-0563-4d17-917f-83545bd31f49 tempest-ProjectMemberTests-966986526 None] Lock "cinder-0dfb6b54-cc15-4935-b118-e811dc53d916-delete_snapshot" released by "delete_snapshot" :: held 1.679s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:06 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0d308958-cfe9-4857-9656-c2ae5dd5c357 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-fe646923-75c2-467c-b885-c44ce0b4290b-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:06 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0d308958-cfe9-4857-9656-c2ae5dd5c357 tempest-ProjectMemberTests-966986526 None] Lock "cinder-fe646923-75c2-467c-b885-c44ce0b4290b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:06 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0d308958-cfe9-4857-9656-c2ae5dd5c357 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-quobyte-fe646923-75c2-467c-b885-c44ce0b4290b" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:06 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0d308958-cfe9-4857-9656-c2ae5dd5c357 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-fe646923-75c2-467c-b885-c44ce0b4290b" acquired by "delete_volume" :: waited 0.019s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:06 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eeb74d8-4d7d-44bb-9713-7c3933f1e0b7]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:06 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0d308958-cfe9-4857-9656-c2ae5dd5c357 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:06 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b Sep 01 08:36:06 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:06 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:06 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0d308958-cfe9-4857-9656-c2ae5dd5c357 tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b" returned: 0 in 0.384s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:06 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0d308958-cfe9-4857-9656-c2ae5dd5c357 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:06 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b Sep 01 08:36:06 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:07 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0d308958-cfe9-4857-9656-c2ae5dd5c357 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-fe646923-75c2-467c-b885-c44ce0b4290b" returned: 0 in 0.253s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:07 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0d308958-cfe9-4857-9656-c2ae5dd5c357 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-fe646923-75c2-467c-b885-c44ce0b4290b" released by "delete_volume" :: held 0.704s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:07 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-0d308958-cfe9-4857-9656-c2ae5dd5c357 tempest-ProjectMemberTests-966986526 None] Created reservations ['3f6b70f8-1c8f-40bf-a0e4-c2ef43b04b8b', '5c0b32c2-d1ca-4543-8682-8900318300d4', 'd69b3470-fc9d-4c56-b182-d8e0d35aed87', '951e5707-62bc-4148-96ef-4d5045406333'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:36:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0d308958-cfe9-4857-9656-c2ae5dd5c357 tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:36:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0d308958-cfe9-4857-9656-c2ae5dd5c357 tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:36:07 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0d308958-cfe9-4857-9656-c2ae5dd5c357 tempest-ProjectMemberTests-966986526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:36:07 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0d308958-cfe9-4857-9656-c2ae5dd5c357 tempest-ProjectMemberTests-966986526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:36:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0d308958-cfe9-4857-9656-c2ae5dd5c357 tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:36:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0d308958-cfe9-4857-9656-c2ae5dd5c357 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:07 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:36:07 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:07 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0d308958-cfe9-4857-9656-c2ae5dd5c357 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.264s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:07 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-0d308958-cfe9-4857-9656-c2ae5dd5c357 tempest-ProjectMemberTests-966986526 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:36:07 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-0d308958-cfe9-4857-9656-c2ae5dd5c357 tempest-ProjectMemberTests-966986526 None] Deleted volume successfully. Sep 01 08:36:07 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0d308958-cfe9-4857-9656-c2ae5dd5c357 tempest-ProjectMemberTests-966986526 None] Lock "cinder-fe646923-75c2-467c-b885-c44ce0b4290b-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:08 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:36:08 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] Flow 'volume_create_manager' (efee7b7a-61d6-4954-b300-5147249a69d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:36:08 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9aa1b6f-1751-45d7-abc9-26a21b888d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:08 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9aa1b6f-1751-45d7-abc9-26a21b888d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1384555915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f0a94f2-0114-476d-8ae0-b2374b380cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ceebf2b634a4548bbd4c6ae9db7ba5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:36:08Z,use_quota=True,user_id='983c5aa98b1a4e0bb6b0bb88c344af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:08 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea9a63e-9c37-4eed-a02a-17b9dd50ff9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:08 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea9a63e-9c37-4eed-a02a-17b9dd50ff9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:08 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d34358-2c66-4618-ac5a-c40f05989bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:08 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d34358-2c66-4618-ac5a-c40f05989bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f0a94f2-0114-476d-8ae0-b2374b380cdb', 'volume_name': 'volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:08 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca01a20-6cd2-449c-8c39-0a8eb54ca6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:08 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca01a20-6cd2-449c-8c39-0a8eb54ca6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:08 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3fe19ce-cb46-4f45-b9b0-08038f9adb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:08 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] Volume 0f0a94f2-0114-476d-8ae0-b2374b380cdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb', 'volume_size': 1} Sep 01 08:36:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:36:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:36:08 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1384555915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f0a94f2-0114-476d-8ae0-b2374b380cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ceebf2b634a4548bbd4c6ae9db7ba5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:36:08Z,use_quota=True,user_id='983c5aa98b1a4e0bb6b0bb88c344af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:36:08 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] Creating volume 0f0a94f2-0114-476d-8ae0-b2374b380cdb {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:36:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:36:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:36:08 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:36:08 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:36:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:36:08 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:36:08 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:36:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:08 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb 1073741824 Sep 01 08:36:08 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:08 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb 1073741824" returned: 0 in 0.409s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:08 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb Sep 01 08:36:08 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:08 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb" returned: 0 in 0.238s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:08 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:36:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:36:08 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3fe19ce-cb46-4f45-b9b0-08038f9adb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:08 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f266586a-b658-4aea-a5e5-727638c79abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:08 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] Volume volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb (0f0a94f2-0114-476d-8ae0-b2374b380cdb): created successfully Sep 01 08:36:08 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f266586a-b658-4aea-a5e5-727638c79abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:08 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] Flow 'volume_create_manager' (efee7b7a-61d6-4954-b300-5147249a69d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:36:08 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-548ba1f5-0ddb-423c-88ad-3acfd7620f5f tempest-ProjectMemberTests-966986526 None] Created volume successfully. Sep 01 08:36:09 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=112,cinder:INSERT=39,cinder:UPDATE=142,cinder:DELETE=13 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:36:09 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=112,cinder:UPDATE=127,cinder:INSERT=41,cinder:DELETE=10 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:36:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-49cf7550-c854-4cc6-a99e-fd6cb41651c6 tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:36:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-49cf7550-c854-4cc6-a99e-fd6cb41651c6 tempest-ProjectMemberTests-966986526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:36:09 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-49cf7550-c854-4cc6-a99e-fd6cb41651c6 tempest-ProjectMemberTests-966986526 None] Creating offline snapshot 4b686a0a-9c48-4e54-a4db-2fdd7d6c4811 of volume 0f0a94f2-0114-476d-8ae0-b2374b380cdb {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:36:09 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[403c5849-1fea-41bc-9a99-5f6ebdd72751]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-49cf7550-c854-4cc6-a99e-fd6cb41651c6 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:09 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb Sep 01 08:36:09 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:09 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-49cf7550-c854-4cc6-a99e-fd6cb41651c6 tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb" returned: 0 in 0.350s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-49cf7550-c854-4cc6-a99e-fd6cb41651c6 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb.4b686a0a-9c48-4e54-a4db-2fdd7d6c4811 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:09 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb.4b686a0a-9c48-4e54-a4db-2fdd7d6c4811 1G Sep 01 08:36:09 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:10 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-49cf7550-c854-4cc6-a99e-fd6cb41651c6 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb.4b686a0a-9c48-4e54-a4db-2fdd7d6c4811 1G" returned: 0 in 0.378s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-49cf7550-c854-4cc6-a99e-fd6cb41651c6 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb.4b686a0a-9c48-4e54-a4db-2fdd7d6c4811 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:10 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb.4b686a0a-9c48-4e54-a4db-2fdd7d6c4811 Sep 01 08:36:10 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:10 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-49cf7550-c854-4cc6-a99e-fd6cb41651c6 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb.4b686a0a-9c48-4e54-a4db-2fdd7d6c4811" returned: 0 in 0.285s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:10 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-49cf7550-c854-4cc6-a99e-fd6cb41651c6 tempest-ProjectMemberTests-966986526 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb.4b686a0a-9c48-4e54-a4db-2fdd7d6c4811 is being set with open permissions: ugo+rw Sep 01 08:36:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-49cf7550-c854-4cc6-a99e-fd6cb41651c6 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb.4b686a0a-9c48-4e54-a4db-2fdd7d6c4811 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:10 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb.4b686a0a-9c48-4e54-a4db-2fdd7d6c4811 Sep 01 08:36:10 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:10 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-49cf7550-c854-4cc6-a99e-fd6cb41651c6 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb.4b686a0a-9c48-4e54-a4db-2fdd7d6c4811" returned: 0 in 0.244s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-49cf7550-c854-4cc6-a99e-fd6cb41651c6 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:10 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb.info Sep 01 08:36:10 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:10 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-49cf7550-c854-4cc6-a99e-fd6cb41651c6 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb.info" returned: 0 in 0.251s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:10 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-49cf7550-c854-4cc6-a99e-fd6cb41651c6 tempest-ProjectMemberTests-966986526 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb.info is being set with open permissions: ugo+rw Sep 01 08:36:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-49cf7550-c854-4cc6-a99e-fd6cb41651c6 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:10 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb.info Sep 01 08:36:10 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:11 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-49cf7550-c854-4cc6-a99e-fd6cb41651c6 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb.info" returned: 0 in 0.239s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-49cf7550-c854-4cc6-a99e-fd6cb41651c6 tempest-ProjectMemberTests-966986526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.823s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:36:11 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-49cf7550-c854-4cc6-a99e-fd6cb41651c6 tempest-ProjectMemberTests-966986526 None] Create snapshot completed successfully Sep 01 08:36:11 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f795b707-ad36-4ee1-bd73-8175a383bdc8 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-4b686a0a-9c48-4e54-a4db-2fdd7d6c4811-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:11 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f795b707-ad36-4ee1-bd73-8175a383bdc8 tempest-ProjectMemberTests-966986526 None] Lock "cinder-4b686a0a-9c48-4e54-a4db-2fdd7d6c4811-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:11 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f795b707-ad36-4ee1-bd73-8175a383bdc8 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-quobyte-0f0a94f2-0114-476d-8ae0-b2374b380cdb" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:11 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f795b707-ad36-4ee1-bd73-8175a383bdc8 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-0f0a94f2-0114-476d-8ae0-b2374b380cdb" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:11 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f795b707-ad36-4ee1-bd73-8175a383bdc8 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-quobyte-4b686a0a-9c48-4e54-a4db-2fdd7d6c4811" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:11 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f795b707-ad36-4ee1-bd73-8175a383bdc8 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-4b686a0a-9c48-4e54-a4db-2fdd7d6c4811" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:11 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-f795b707-ad36-4ee1-bd73-8175a383bdc8 tempest-ProjectMemberTests-966986526 None] Deleting offline snapshot 4b686a0a-9c48-4e54-a4db-2fdd7d6c4811 of volume 0f0a94f2-0114-476d-8ae0-b2374b380cdb {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:36:11 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-f795b707-ad36-4ee1-bd73-8175a383bdc8 tempest-ProjectMemberTests-966986526 None] snapshot_file for this snap is: volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb.4b686a0a-9c48-4e54-a4db-2fdd7d6c4811 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:36:11 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[219e0eb1-0a4f-4ff6-8505-9beeeaf62574]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f795b707-ad36-4ee1-bd73-8175a383bdc8 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb.4b686a0a-9c48-4e54-a4db-2fdd7d6c4811 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:11 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb.4b686a0a-9c48-4e54-a4db-2fdd7d6c4811 Sep 01 08:36:11 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:11 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f795b707-ad36-4ee1-bd73-8175a383bdc8 tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb.4b686a0a-9c48-4e54-a4db-2fdd7d6c4811" returned: 0 in 0.353s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:11 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-f795b707-ad36-4ee1-bd73-8175a383bdc8 tempest-ProjectMemberTests-966986526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:36:11 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d8d10e-761a-49b6-9104-c4bc82b32c4f]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f795b707-ad36-4ee1-bd73-8175a383bdc8 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:11 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb Sep 01 08:36:11 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:12 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f795b707-ad36-4ee1-bd73-8175a383bdc8 tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb" returned: 0 in 0.360s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f795b707-ad36-4ee1-bd73-8175a383bdc8 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb.4b686a0a-9c48-4e54-a4db-2fdd7d6c4811 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:12 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb.4b686a0a-9c48-4e54-a4db-2fdd7d6c4811 Sep 01 08:36:12 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:12 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f795b707-ad36-4ee1-bd73-8175a383bdc8 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb.4b686a0a-9c48-4e54-a4db-2fdd7d6c4811" returned: 0 in 0.325s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f795b707-ad36-4ee1-bd73-8175a383bdc8 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb.4b686a0a-9c48-4e54-a4db-2fdd7d6c4811 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:12 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb.4b686a0a-9c48-4e54-a4db-2fdd7d6c4811 Sep 01 08:36:12 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:12 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f795b707-ad36-4ee1-bd73-8175a383bdc8 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb.4b686a0a-9c48-4e54-a4db-2fdd7d6c4811" returned: 0 in 0.254s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:12 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f795b707-ad36-4ee1-bd73-8175a383bdc8 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-4b686a0a-9c48-4e54-a4db-2fdd7d6c4811" released by "_delete_snapshot" :: held 1.380s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:12 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f795b707-ad36-4ee1-bd73-8175a383bdc8 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-0f0a94f2-0114-476d-8ae0-b2374b380cdb" released by "delete_snapshot" :: held 1.401s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:12 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-f795b707-ad36-4ee1-bd73-8175a383bdc8 tempest-ProjectMemberTests-966986526 None] Created reservations ['067a186a-7902-4a42-8a34-7bfb561090df', '3a43a704-de82-4ce8-a8fa-80c3ed76addd', '66177c2b-9f27-4e5b-9c31-40cf3903606d', 'fe6502c3-a0be-4fa2-a3ff-6b02eedc988f'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:36:12 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-f795b707-ad36-4ee1-bd73-8175a383bdc8 tempest-ProjectMemberTests-966986526 None] Delete snapshot completed successfully. Sep 01 08:36:12 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f795b707-ad36-4ee1-bd73-8175a383bdc8 tempest-ProjectMemberTests-966986526 None] Lock "cinder-4b686a0a-9c48-4e54-a4db-2fdd7d6c4811-delete_snapshot" released by "delete_snapshot" :: held 1.526s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:13 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-503200a6-1554-457a-a2fb-8500b7ea05ce tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-0f0a94f2-0114-476d-8ae0-b2374b380cdb-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:13 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-503200a6-1554-457a-a2fb-8500b7ea05ce tempest-ProjectMemberTests-966986526 None] Lock "cinder-0f0a94f2-0114-476d-8ae0-b2374b380cdb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:13 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-503200a6-1554-457a-a2fb-8500b7ea05ce tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-quobyte-0f0a94f2-0114-476d-8ae0-b2374b380cdb" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:13 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-503200a6-1554-457a-a2fb-8500b7ea05ce tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-0f0a94f2-0114-476d-8ae0-b2374b380cdb" acquired by "delete_volume" :: waited 0.016s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:13 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b5c595-d2f2-4acc-b82c-e6b9d01eef60]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-503200a6-1554-457a-a2fb-8500b7ea05ce tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:13 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb Sep 01 08:36:13 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:13 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-503200a6-1554-457a-a2fb-8500b7ea05ce tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb" returned: 0 in 0.353s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-503200a6-1554-457a-a2fb-8500b7ea05ce tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:14 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb Sep 01 08:36:14 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:14 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-503200a6-1554-457a-a2fb-8500b7ea05ce tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-0f0a94f2-0114-476d-8ae0-b2374b380cdb" returned: 0 in 0.249s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:14 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-503200a6-1554-457a-a2fb-8500b7ea05ce tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-0f0a94f2-0114-476d-8ae0-b2374b380cdb" released by "delete_volume" :: held 0.663s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:14 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-503200a6-1554-457a-a2fb-8500b7ea05ce tempest-ProjectMemberTests-966986526 None] Created reservations ['6c4f1a48-daa5-4290-81b9-4b615fb664f3', 'd8986a97-cf4c-41bc-94a9-e09f7724d7f5', 'f866328f-8385-4656-8a8f-488d29b6004f', '2df138b7-eeab-4aa8-91f0-03f027f707f1'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:36:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-503200a6-1554-457a-a2fb-8500b7ea05ce tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:36:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-503200a6-1554-457a-a2fb-8500b7ea05ce tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:36:14 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-503200a6-1554-457a-a2fb-8500b7ea05ce tempest-ProjectMemberTests-966986526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:36:14 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-503200a6-1554-457a-a2fb-8500b7ea05ce tempest-ProjectMemberTests-966986526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:36:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-503200a6-1554-457a-a2fb-8500b7ea05ce tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:36:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-503200a6-1554-457a-a2fb-8500b7ea05ce tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:14 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:36:14 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:14 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-503200a6-1554-457a-a2fb-8500b7ea05ce tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.269s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:14 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-503200a6-1554-457a-a2fb-8500b7ea05ce tempest-ProjectMemberTests-966986526 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:36:14 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-503200a6-1554-457a-a2fb-8500b7ea05ce tempest-ProjectMemberTests-966986526 None] Deleted volume successfully. Sep 01 08:36:14 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-503200a6-1554-457a-a2fb-8500b7ea05ce tempest-ProjectMemberTests-966986526 None] Lock "cinder-0f0a94f2-0114-476d-8ae0-b2374b380cdb-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:15 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:36:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] Flow 'volume_create_manager' (c1493d3c-9ac4-4f38-b7fe-9721ccddd18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:36:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4d546d-dde1-417b-874c-4a9873679efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4d546d-dde1-417b-874c-4a9873679efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1708077504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa997c9d-ce33-4eb8-b72b-d89b311f8686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ceebf2b634a4548bbd4c6ae9db7ba5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:36:15Z,use_quota=True,user_id='983c5aa98b1a4e0bb6b0bb88c344af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d4732fe-21e1-43ec-897a-80c08e5ea6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d4732fe-21e1-43ec-897a-80c08e5ea6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c71706c-ed87-4636-9ddc-8abafea72014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c71706c-ed87-4636-9ddc-8abafea72014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa997c9d-ce33-4eb8-b72b-d89b311f8686', 'volume_name': 'volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c859e7-9a1a-4d5c-8428-b286ba29a3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c859e7-9a1a-4d5c-8428-b286ba29a3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad78a0e-062e-47a6-a233-ef15744bb628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:15 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] Volume aa997c9d-ce33-4eb8-b72b-d89b311f8686: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686', 'volume_size': 1} Sep 01 08:36:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:36:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:36:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1708077504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa997c9d-ce33-4eb8-b72b-d89b311f8686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ceebf2b634a4548bbd4c6ae9db7ba5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:36:15Z,use_quota=True,user_id='983c5aa98b1a4e0bb6b0bb88c344af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:36:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] Creating volume aa997c9d-ce33-4eb8-b72b-d89b311f8686 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:36:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:36:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:36:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:36:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:36:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:36:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:36:15 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:36:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:15 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686 1073741824 Sep 01 08:36:15 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:15 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686 1073741824" returned: 0 in 0.408s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:15 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686 Sep 01 08:36:15 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:15 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686" returned: 0 in 0.247s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:15 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:36:15 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:36:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad78a0e-062e-47a6-a233-ef15744bb628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b81484-ce6b-4763-b786-d39b7e0fefbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:15 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] Volume volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686 (aa997c9d-ce33-4eb8-b72b-d89b311f8686): created successfully Sep 01 08:36:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b81484-ce6b-4763-b786-d39b7e0fefbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:15 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] Flow 'volume_create_manager' (c1493d3c-9ac4-4f38-b7fe-9721ccddd18d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:36:15 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-cb19716b-13f4-4be0-a8df-60aac6240145 tempest-ProjectMemberTests-966986526 None] Created volume successfully. Sep 01 08:36:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8c70a77c-4879-416b-918a-b159ede8e7ea tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:36:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8c70a77c-4879-416b-918a-b159ede8e7ea tempest-ProjectMemberTests-966986526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:36:16 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-8c70a77c-4879-416b-918a-b159ede8e7ea tempest-ProjectMemberTests-966986526 None] Creating offline snapshot 580dc050-c34d-4086-ae09-92947d489061 of volume aa997c9d-ce33-4eb8-b72b-d89b311f8686 {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:36:16 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c450d7-88a0-472e-88c6-015a1dc2ebce]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8c70a77c-4879-416b-918a-b159ede8e7ea tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:16 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686 Sep 01 08:36:16 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:16 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8c70a77c-4879-416b-918a-b159ede8e7ea tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686" returned: 0 in 0.360s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:16 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8c70a77c-4879-416b-918a-b159ede8e7ea tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686.580dc050-c34d-4086-ae09-92947d489061 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:16 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686.580dc050-c34d-4086-ae09-92947d489061 1G Sep 01 08:36:16 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:17 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8c70a77c-4879-416b-918a-b159ede8e7ea tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686.580dc050-c34d-4086-ae09-92947d489061 1G" returned: 0 in 0.379s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8c70a77c-4879-416b-918a-b159ede8e7ea tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686.580dc050-c34d-4086-ae09-92947d489061 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:17 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686.580dc050-c34d-4086-ae09-92947d489061 Sep 01 08:36:17 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:17 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8c70a77c-4879-416b-918a-b159ede8e7ea tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686.580dc050-c34d-4086-ae09-92947d489061" returned: 0 in 0.281s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:17 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-8c70a77c-4879-416b-918a-b159ede8e7ea tempest-ProjectMemberTests-966986526 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686.580dc050-c34d-4086-ae09-92947d489061 is being set with open permissions: ugo+rw Sep 01 08:36:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8c70a77c-4879-416b-918a-b159ede8e7ea tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686.580dc050-c34d-4086-ae09-92947d489061 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:17 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686.580dc050-c34d-4086-ae09-92947d489061 Sep 01 08:36:17 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:17 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8c70a77c-4879-416b-918a-b159ede8e7ea tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686.580dc050-c34d-4086-ae09-92947d489061" returned: 0 in 0.248s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8c70a77c-4879-416b-918a-b159ede8e7ea tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:17 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686.info Sep 01 08:36:17 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:17 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8c70a77c-4879-416b-918a-b159ede8e7ea tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686.info" returned: 0 in 0.250s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:17 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-8c70a77c-4879-416b-918a-b159ede8e7ea tempest-ProjectMemberTests-966986526 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686.info is being set with open permissions: ugo+rw Sep 01 08:36:17 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8c70a77c-4879-416b-918a-b159ede8e7ea tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:17 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686.info Sep 01 08:36:17 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:18 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8c70a77c-4879-416b-918a-b159ede8e7ea tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686.info" returned: 0 in 0.249s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8c70a77c-4879-416b-918a-b159ede8e7ea tempest-ProjectMemberTests-966986526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.888s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:36:18 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-8c70a77c-4879-416b-918a-b159ede8e7ea tempest-ProjectMemberTests-966986526 None] Create snapshot completed successfully Sep 01 08:36:18 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f488b279-9e9d-43b7-b071-c02462d534fa tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-580dc050-c34d-4086-ae09-92947d489061-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:18 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f488b279-9e9d-43b7-b071-c02462d534fa tempest-ProjectMemberTests-966986526 None] Lock "cinder-580dc050-c34d-4086-ae09-92947d489061-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:18 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f488b279-9e9d-43b7-b071-c02462d534fa tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-quobyte-aa997c9d-ce33-4eb8-b72b-d89b311f8686" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:18 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f488b279-9e9d-43b7-b071-c02462d534fa tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-aa997c9d-ce33-4eb8-b72b-d89b311f8686" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:18 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f488b279-9e9d-43b7-b071-c02462d534fa tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-quobyte-580dc050-c34d-4086-ae09-92947d489061" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:18 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f488b279-9e9d-43b7-b071-c02462d534fa tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-580dc050-c34d-4086-ae09-92947d489061" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:18 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-f488b279-9e9d-43b7-b071-c02462d534fa tempest-ProjectMemberTests-966986526 None] Deleting offline snapshot 580dc050-c34d-4086-ae09-92947d489061 of volume aa997c9d-ce33-4eb8-b72b-d89b311f8686 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:36:18 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-f488b279-9e9d-43b7-b071-c02462d534fa tempest-ProjectMemberTests-966986526 None] snapshot_file for this snap is: volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686.580dc050-c34d-4086-ae09-92947d489061 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:36:18 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8056bb4-c36f-4367-9dea-5818432307fa]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f488b279-9e9d-43b7-b071-c02462d534fa tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686.580dc050-c34d-4086-ae09-92947d489061 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:18 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686.580dc050-c34d-4086-ae09-92947d489061 Sep 01 08:36:18 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:18 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f488b279-9e9d-43b7-b071-c02462d534fa tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686.580dc050-c34d-4086-ae09-92947d489061" returned: 0 in 0.355s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:18 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-f488b279-9e9d-43b7-b071-c02462d534fa tempest-ProjectMemberTests-966986526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:36:18 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa00a23-1776-42e6-bb20-40b655fa5799]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:18 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f488b279-9e9d-43b7-b071-c02462d534fa tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:18 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686 Sep 01 08:36:18 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:19 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f488b279-9e9d-43b7-b071-c02462d534fa tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686" returned: 0 in 0.354s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f488b279-9e9d-43b7-b071-c02462d534fa tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686.580dc050-c34d-4086-ae09-92947d489061 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:19 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686.580dc050-c34d-4086-ae09-92947d489061 Sep 01 08:36:19 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:19 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f488b279-9e9d-43b7-b071-c02462d534fa tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686.580dc050-c34d-4086-ae09-92947d489061" returned: 0 in 0.333s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f488b279-9e9d-43b7-b071-c02462d534fa tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686.580dc050-c34d-4086-ae09-92947d489061 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:19 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686.580dc050-c34d-4086-ae09-92947d489061 Sep 01 08:36:19 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:19 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:19 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f488b279-9e9d-43b7-b071-c02462d534fa tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686.580dc050-c34d-4086-ae09-92947d489061" returned: 0 in 0.245s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:19 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f488b279-9e9d-43b7-b071-c02462d534fa tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-580dc050-c34d-4086-ae09-92947d489061" released by "_delete_snapshot" :: held 1.371s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:19 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f488b279-9e9d-43b7-b071-c02462d534fa tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-aa997c9d-ce33-4eb8-b72b-d89b311f8686" released by "delete_snapshot" :: held 1.395s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:19 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-f488b279-9e9d-43b7-b071-c02462d534fa tempest-ProjectMemberTests-966986526 None] Created reservations ['6f6d0add-5f68-4d5b-8a3a-332627f6393a', 'bcdc089c-6de0-4fc7-99cd-817f3151e78d', '3adc28f6-542c-41bb-a770-c36f736feb4a', '153d023d-66e1-41da-a773-3cda75671caa'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:36:19 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-f488b279-9e9d-43b7-b071-c02462d534fa tempest-ProjectMemberTests-966986526 None] Delete snapshot completed successfully. Sep 01 08:36:19 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-f488b279-9e9d-43b7-b071-c02462d534fa tempest-ProjectMemberTests-966986526 None] Lock "cinder-580dc050-c34d-4086-ae09-92947d489061-delete_snapshot" released by "delete_snapshot" :: held 1.513s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a87c12cf-506a-4ca4-b12d-4676b591693f tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-aa997c9d-ce33-4eb8-b72b-d89b311f8686-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a87c12cf-506a-4ca4-b12d-4676b591693f tempest-ProjectMemberTests-966986526 None] Lock "cinder-aa997c9d-ce33-4eb8-b72b-d89b311f8686-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a87c12cf-506a-4ca4-b12d-4676b591693f tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-quobyte-aa997c9d-ce33-4eb8-b72b-d89b311f8686" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:20 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a87c12cf-506a-4ca4-b12d-4676b591693f tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-aa997c9d-ce33-4eb8-b72b-d89b311f8686" acquired by "delete_volume" :: waited 0.019s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:20 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4b2e1f-ddff-423c-900b-5d714badab10]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:20 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a87c12cf-506a-4ca4-b12d-4676b591693f tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:20 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686 Sep 01 08:36:20 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:21 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a87c12cf-506a-4ca4-b12d-4676b591693f tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686" returned: 0 in 0.349s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a87c12cf-506a-4ca4-b12d-4676b591693f tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:21 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686 Sep 01 08:36:21 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:21 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a87c12cf-506a-4ca4-b12d-4676b591693f tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-aa997c9d-ce33-4eb8-b72b-d89b311f8686" returned: 0 in 0.245s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:21 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a87c12cf-506a-4ca4-b12d-4676b591693f tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-aa997c9d-ce33-4eb8-b72b-d89b311f8686" released by "delete_volume" :: held 0.649s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:21 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-a87c12cf-506a-4ca4-b12d-4676b591693f tempest-ProjectMemberTests-966986526 None] Created reservations ['693e5a60-f42c-4536-a3fc-42ec8d8773a1', '128aed08-b521-424d-a989-82f2e26b9a69', 'e27053e0-3cd0-4e0b-942b-164a1c032cb5', 'd1c8a9e7-a6a6-4731-a4ce-2ee0fb545e00'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:36:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a87c12cf-506a-4ca4-b12d-4676b591693f tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:36:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a87c12cf-506a-4ca4-b12d-4676b591693f tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:36:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a87c12cf-506a-4ca4-b12d-4676b591693f tempest-ProjectMemberTests-966986526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:36:21 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a87c12cf-506a-4ca4-b12d-4676b591693f tempest-ProjectMemberTests-966986526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:36:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a87c12cf-506a-4ca4-b12d-4676b591693f tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:36:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a87c12cf-506a-4ca4-b12d-4676b591693f tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:21 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:36:21 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:21 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:21 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a87c12cf-506a-4ca4-b12d-4676b591693f tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.251s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:21 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-a87c12cf-506a-4ca4-b12d-4676b591693f tempest-ProjectMemberTests-966986526 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:36:21 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-a87c12cf-506a-4ca4-b12d-4676b591693f tempest-ProjectMemberTests-966986526 None] Deleted volume successfully. Sep 01 08:36:21 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-a87c12cf-506a-4ca4-b12d-4676b591693f tempest-ProjectMemberTests-966986526 None] Lock "cinder-aa997c9d-ce33-4eb8-b72b-d89b311f8686-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:22 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:36:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] Flow 'volume_create_manager' (4d65df98-91ea-40a5-ba7b-7a5eebfb8782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:36:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92d9a9dc-796f-4936-a302-d774effe084d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92d9a9dc-796f-4936-a302-d774effe084d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1439419468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2912826a-5401-495a-94c2-94d2d9ea8b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ceebf2b634a4548bbd4c6ae9db7ba5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:36:22Z,use_quota=True,user_id='983c5aa98b1a4e0bb6b0bb88c344af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (405d7b80-0888-4dc8-bafe-e86f2be1be7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (405d7b80-0888-4dc8-bafe-e86f2be1be7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db12d3e-0194-4500-99c5-5aadd193a10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db12d3e-0194-4500-99c5-5aadd193a10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2912826a-5401-495a-94c2-94d2d9ea8b9d', 'volume_name': 'volume-2912826a-5401-495a-94c2-94d2d9ea8b9d', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1408b88-5837-4abd-afdb-3afb89c1de48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1408b88-5837-4abd-afdb-3afb89c1de48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58724fb0-cf99-4dde-9086-00ce5b56a869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:22 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] Volume 2912826a-5401-495a-94c2-94d2d9ea8b9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2912826a-5401-495a-94c2-94d2d9ea8b9d', 'volume_size': 1} Sep 01 08:36:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:36:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:36:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1439419468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2912826a-5401-495a-94c2-94d2d9ea8b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ceebf2b634a4548bbd4c6ae9db7ba5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:36:22Z,use_quota=True,user_id='983c5aa98b1a4e0bb6b0bb88c344af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:36:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] Creating volume 2912826a-5401-495a-94c2-94d2d9ea8b9d {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:36:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:36:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:36:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:36:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:36:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:36:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:36:22 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:36:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:22 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d 1073741824 Sep 01 08:36:22 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:22 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d 1073741824" returned: 0 in 0.409s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:22 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d Sep 01 08:36:22 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:22 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d" returned: 0 in 0.244s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:22 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:36:22 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:36:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58724fb0-cf99-4dde-9086-00ce5b56a869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2912826a-5401-495a-94c2-94d2d9ea8b9d', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b316ba-cffd-4211-a66d-e48b73c4f910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:22 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] Volume volume-2912826a-5401-495a-94c2-94d2d9ea8b9d (2912826a-5401-495a-94c2-94d2d9ea8b9d): created successfully Sep 01 08:36:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b316ba-cffd-4211-a66d-e48b73c4f910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:22 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] Flow 'volume_create_manager' (4d65df98-91ea-40a5-ba7b-7a5eebfb8782) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:36:22 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-a748b16b-6a39-4d85-a79f-6ebad57e1fd5 tempest-ProjectMemberTests-966986526 None] Created volume successfully. Sep 01 08:36:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4d7a5a86-7e32-4075-b2f7-07e91631cc90 tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:36:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4d7a5a86-7e32-4075-b2f7-07e91631cc90 tempest-ProjectMemberTests-966986526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:36:23 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-4d7a5a86-7e32-4075-b2f7-07e91631cc90 tempest-ProjectMemberTests-966986526 None] Creating offline snapshot 32d08ff8-a62d-4454-ace6-a3bdfd71a1a4 of volume 2912826a-5401-495a-94c2-94d2d9ea8b9d {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:36:23 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d321cad-5a5a-491c-869e-4d289a877cf2]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4d7a5a86-7e32-4075-b2f7-07e91631cc90 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:23 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d Sep 01 08:36:23 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:23 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4d7a5a86-7e32-4075-b2f7-07e91631cc90 tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d" returned: 0 in 0.363s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:23 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4d7a5a86-7e32-4075-b2f7-07e91631cc90 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d.32d08ff8-a62d-4454-ace6-a3bdfd71a1a4 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:23 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d.32d08ff8-a62d-4454-ace6-a3bdfd71a1a4 1G Sep 01 08:36:23 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:24 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4d7a5a86-7e32-4075-b2f7-07e91631cc90 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d.32d08ff8-a62d-4454-ace6-a3bdfd71a1a4 1G" returned: 0 in 0.377s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4d7a5a86-7e32-4075-b2f7-07e91631cc90 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2912826a-5401-495a-94c2-94d2d9ea8b9d -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d.32d08ff8-a62d-4454-ace6-a3bdfd71a1a4 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:24 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2912826a-5401-495a-94c2-94d2d9ea8b9d -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d.32d08ff8-a62d-4454-ace6-a3bdfd71a1a4 Sep 01 08:36:24 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:24 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4d7a5a86-7e32-4075-b2f7-07e91631cc90 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2912826a-5401-495a-94c2-94d2d9ea8b9d -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d.32d08ff8-a62d-4454-ace6-a3bdfd71a1a4" returned: 0 in 0.296s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:24 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-4d7a5a86-7e32-4075-b2f7-07e91631cc90 tempest-ProjectMemberTests-966986526 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d.32d08ff8-a62d-4454-ace6-a3bdfd71a1a4 is being set with open permissions: ugo+rw Sep 01 08:36:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4d7a5a86-7e32-4075-b2f7-07e91631cc90 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d.32d08ff8-a62d-4454-ace6-a3bdfd71a1a4 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:24 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d.32d08ff8-a62d-4454-ace6-a3bdfd71a1a4 Sep 01 08:36:24 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:24 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4d7a5a86-7e32-4075-b2f7-07e91631cc90 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d.32d08ff8-a62d-4454-ace6-a3bdfd71a1a4" returned: 0 in 0.245s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4d7a5a86-7e32-4075-b2f7-07e91631cc90 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:24 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d.info Sep 01 08:36:24 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:24 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4d7a5a86-7e32-4075-b2f7-07e91631cc90 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d.info" returned: 0 in 0.245s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:24 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-4d7a5a86-7e32-4075-b2f7-07e91631cc90 tempest-ProjectMemberTests-966986526 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d.info is being set with open permissions: ugo+rw Sep 01 08:36:24 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4d7a5a86-7e32-4075-b2f7-07e91631cc90 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:24 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d.info Sep 01 08:36:24 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:25 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4d7a5a86-7e32-4075-b2f7-07e91631cc90 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d.info" returned: 0 in 0.241s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4d7a5a86-7e32-4075-b2f7-07e91631cc90 tempest-ProjectMemberTests-966986526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.845s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:36:25 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-4d7a5a86-7e32-4075-b2f7-07e91631cc90 tempest-ProjectMemberTests-966986526 None] Create snapshot completed successfully Sep 01 08:36:25 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8be80f62-6a74-4ae6-9f88-282e352f3595 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-32d08ff8-a62d-4454-ace6-a3bdfd71a1a4-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:25 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8be80f62-6a74-4ae6-9f88-282e352f3595 tempest-ProjectMemberTests-966986526 None] Lock "cinder-32d08ff8-a62d-4454-ace6-a3bdfd71a1a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:25 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8be80f62-6a74-4ae6-9f88-282e352f3595 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-quobyte-2912826a-5401-495a-94c2-94d2d9ea8b9d" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:25 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8be80f62-6a74-4ae6-9f88-282e352f3595 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-2912826a-5401-495a-94c2-94d2d9ea8b9d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:25 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8be80f62-6a74-4ae6-9f88-282e352f3595 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-quobyte-32d08ff8-a62d-4454-ace6-a3bdfd71a1a4" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:25 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8be80f62-6a74-4ae6-9f88-282e352f3595 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-32d08ff8-a62d-4454-ace6-a3bdfd71a1a4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-8be80f62-6a74-4ae6-9f88-282e352f3595 tempest-ProjectMemberTests-966986526 None] Deleting offline snapshot 32d08ff8-a62d-4454-ace6-a3bdfd71a1a4 of volume 2912826a-5401-495a-94c2-94d2d9ea8b9d {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:36:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-8be80f62-6a74-4ae6-9f88-282e352f3595 tempest-ProjectMemberTests-966986526 None] snapshot_file for this snap is: volume-2912826a-5401-495a-94c2-94d2d9ea8b9d.32d08ff8-a62d-4454-ace6-a3bdfd71a1a4 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:36:25 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c20e50-5d35-4fcc-b29e-58979f2155c9]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8be80f62-6a74-4ae6-9f88-282e352f3595 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d.32d08ff8-a62d-4454-ace6-a3bdfd71a1a4 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:25 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d.32d08ff8-a62d-4454-ace6-a3bdfd71a1a4 Sep 01 08:36:25 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:25 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8be80f62-6a74-4ae6-9f88-282e352f3595 tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d.32d08ff8-a62d-4454-ace6-a3bdfd71a1a4" returned: 0 in 0.359s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:25 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-8be80f62-6a74-4ae6-9f88-282e352f3595 tempest-ProjectMemberTests-966986526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2912826a-5401-495a-94c2-94d2d9ea8b9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:36:25 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9b5d20-57a6-470a-9637-254758e81313]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:25 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8be80f62-6a74-4ae6-9f88-282e352f3595 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:26 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d Sep 01 08:36:26 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:26 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8be80f62-6a74-4ae6-9f88-282e352f3595 tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d" returned: 0 in 0.352s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8be80f62-6a74-4ae6-9f88-282e352f3595 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d.32d08ff8-a62d-4454-ace6-a3bdfd71a1a4 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:26 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d.32d08ff8-a62d-4454-ace6-a3bdfd71a1a4 Sep 01 08:36:26 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:26 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8be80f62-6a74-4ae6-9f88-282e352f3595 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d.32d08ff8-a62d-4454-ace6-a3bdfd71a1a4" returned: 0 in 0.335s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8be80f62-6a74-4ae6-9f88-282e352f3595 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d.32d08ff8-a62d-4454-ace6-a3bdfd71a1a4 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:26 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d.32d08ff8-a62d-4454-ace6-a3bdfd71a1a4 Sep 01 08:36:26 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:26 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:26 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8be80f62-6a74-4ae6-9f88-282e352f3595 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d.32d08ff8-a62d-4454-ace6-a3bdfd71a1a4" returned: 0 in 0.244s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:26 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8be80f62-6a74-4ae6-9f88-282e352f3595 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-32d08ff8-a62d-4454-ace6-a3bdfd71a1a4" released by "_delete_snapshot" :: held 1.374s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:26 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8be80f62-6a74-4ae6-9f88-282e352f3595 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-2912826a-5401-495a-94c2-94d2d9ea8b9d" released by "delete_snapshot" :: held 1.397s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:26 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-8be80f62-6a74-4ae6-9f88-282e352f3595 tempest-ProjectMemberTests-966986526 None] Created reservations ['82deb5aa-4f68-43ac-8191-20184ec1eb20', '9decf3f8-bc5d-4a79-8316-9ac96edc1fd8', 'b9d94b70-7214-4a46-ad39-2e9b67be0ef4', 'd2e32b40-2ae5-4145-871d-44c2e8e68d98'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:36:26 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-8be80f62-6a74-4ae6-9f88-282e352f3595 tempest-ProjectMemberTests-966986526 None] Delete snapshot completed successfully. Sep 01 08:36:26 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8be80f62-6a74-4ae6-9f88-282e352f3595 tempest-ProjectMemberTests-966986526 None] Lock "cinder-32d08ff8-a62d-4454-ace6-a3bdfd71a1a4-delete_snapshot" released by "delete_snapshot" :: held 1.529s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:27 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0479bf06-13f7-49d3-847b-1994ac46db3b tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-2912826a-5401-495a-94c2-94d2d9ea8b9d-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:27 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0479bf06-13f7-49d3-847b-1994ac46db3b tempest-ProjectMemberTests-966986526 None] Lock "cinder-2912826a-5401-495a-94c2-94d2d9ea8b9d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:27 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0479bf06-13f7-49d3-847b-1994ac46db3b tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-quobyte-2912826a-5401-495a-94c2-94d2d9ea8b9d" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:27 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0479bf06-13f7-49d3-847b-1994ac46db3b tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-2912826a-5401-495a-94c2-94d2d9ea8b9d" acquired by "delete_volume" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:27 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[a054e166-c45d-4ab1-9fd3-61a79649a608]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:27 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0479bf06-13f7-49d3-847b-1994ac46db3b tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:27 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d Sep 01 08:36:27 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:28 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0479bf06-13f7-49d3-847b-1994ac46db3b tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d" returned: 0 in 0.355s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0479bf06-13f7-49d3-847b-1994ac46db3b tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:28 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d Sep 01 08:36:28 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:28 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0479bf06-13f7-49d3-847b-1994ac46db3b tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2912826a-5401-495a-94c2-94d2d9ea8b9d" returned: 0 in 0.253s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0479bf06-13f7-49d3-847b-1994ac46db3b tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-2912826a-5401-495a-94c2-94d2d9ea8b9d" released by "delete_volume" :: held 0.661s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:28 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-0479bf06-13f7-49d3-847b-1994ac46db3b tempest-ProjectMemberTests-966986526 None] Created reservations ['096edc2f-1a61-42ef-9a0f-aeb210be00d1', 'cf950b9e-bc47-41fe-afa4-166c6142bd1b', '52b20fef-b0bc-40c3-891b-36bf8512e26a', '8020c76b-9141-4824-9162-edfbea3ba6cc'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:36:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0479bf06-13f7-49d3-847b-1994ac46db3b tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:36:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0479bf06-13f7-49d3-847b-1994ac46db3b tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:36:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0479bf06-13f7-49d3-847b-1994ac46db3b tempest-ProjectMemberTests-966986526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:36:28 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0479bf06-13f7-49d3-847b-1994ac46db3b tempest-ProjectMemberTests-966986526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:36:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0479bf06-13f7-49d3-847b-1994ac46db3b tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:36:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0479bf06-13f7-49d3-847b-1994ac46db3b tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:28 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:36:28 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:28 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:28 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0479bf06-13f7-49d3-847b-1994ac46db3b tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.253s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:28 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-0479bf06-13f7-49d3-847b-1994ac46db3b tempest-ProjectMemberTests-966986526 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:36:28 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-0479bf06-13f7-49d3-847b-1994ac46db3b tempest-ProjectMemberTests-966986526 None] Deleted volume successfully. Sep 01 08:36:28 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-0479bf06-13f7-49d3-847b-1994ac46db3b tempest-ProjectMemberTests-966986526 None] Lock "cinder-2912826a-5401-495a-94c2-94d2d9ea8b9d-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:29 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:36:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] Flow 'volume_create_manager' (6b948e11-60fa-42aa-abd4-0ce4d626e5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:36:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c6bb63-39ce-435f-9d84-4f181d65fb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c6bb63-39ce-435f-9d84-4f181d65fb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-289784914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c1a9dd2-eef3-49bd-9c0d-23835b643c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ceebf2b634a4548bbd4c6ae9db7ba5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:36:29Z,use_quota=True,user_id='983c5aa98b1a4e0bb6b0bb88c344af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b4b22e7-d7ba-457e-8f9b-fbccb1807e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b4b22e7-d7ba-457e-8f9b-fbccb1807e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5e0453-3b00-4277-a1df-180bafd9e2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5e0453-3b00-4277-a1df-180bafd9e2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c1a9dd2-eef3-49bd-9c0d-23835b643c47', 'volume_name': 'volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df641c9-3223-468e-bdd8-3f478cccbe1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df641c9-3223-468e-bdd8-3f478cccbe1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ef4d6e8-131d-4a8f-a241-426b918dd0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:29 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] Volume 2c1a9dd2-eef3-49bd-9c0d-23835b643c47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47', 'volume_size': 1} Sep 01 08:36:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:36:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:36:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-289784914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c1a9dd2-eef3-49bd-9c0d-23835b643c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ceebf2b634a4548bbd4c6ae9db7ba5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:36:29Z,use_quota=True,user_id='983c5aa98b1a4e0bb6b0bb88c344af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:36:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] Creating volume 2c1a9dd2-eef3-49bd-9c0d-23835b643c47 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:36:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:36:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:36:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:36:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:36:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:36:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:36:29 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:36:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:29 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47 1073741824 Sep 01 08:36:29 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:29 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47 1073741824" returned: 0 in 0.409s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:29 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47 Sep 01 08:36:29 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:29 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47" returned: 0 in 0.245s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:29 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:36:29 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:36:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ef4d6e8-131d-4a8f-a241-426b918dd0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb2a5656-a925-4ec7-8f12-7ef191aa67fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:29 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] Volume volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47 (2c1a9dd2-eef3-49bd-9c0d-23835b643c47): created successfully Sep 01 08:36:29 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb2a5656-a925-4ec7-8f12-7ef191aa67fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:30 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] Flow 'volume_create_manager' (6b948e11-60fa-42aa-abd4-0ce4d626e5c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:36:30 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-bd28895c-6eb2-455b-9dd6-f79e46af3ef0 tempest-ProjectMemberTests-966986526 None] Created volume successfully. Sep 01 08:36:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b145a5d7-46b1-4cf4-920e-c60663fb1312 tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:36:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b145a5d7-46b1-4cf4-920e-c60663fb1312 tempest-ProjectMemberTests-966986526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:36:30 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-b145a5d7-46b1-4cf4-920e-c60663fb1312 tempest-ProjectMemberTests-966986526 None] Creating offline snapshot 7b8e6655-eb17-474d-a82d-8fea2071eb69 of volume 2c1a9dd2-eef3-49bd-9c0d-23835b643c47 {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:36:30 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5f4342-a028-4961-bebe-88e4c021c4fb]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b145a5d7-46b1-4cf4-920e-c60663fb1312 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:30 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47 Sep 01 08:36:30 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:30 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b145a5d7-46b1-4cf4-920e-c60663fb1312 tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47" returned: 0 in 0.360s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:30 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b145a5d7-46b1-4cf4-920e-c60663fb1312 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47.7b8e6655-eb17-474d-a82d-8fea2071eb69 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:30 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47.7b8e6655-eb17-474d-a82d-8fea2071eb69 1G Sep 01 08:36:30 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:36:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:36:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:36:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:36:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:36:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:36:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:31 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b145a5d7-46b1-4cf4-920e-c60663fb1312 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47.7b8e6655-eb17-474d-a82d-8fea2071eb69 1G" returned: 0 in 0.383s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b145a5d7-46b1-4cf4-920e-c60663fb1312 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47.7b8e6655-eb17-474d-a82d-8fea2071eb69 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:31 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:36:31 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:31 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47.7b8e6655-eb17-474d-a82d-8fea2071eb69 Sep 01 08:36:31 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:31 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.250s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:31 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:36:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager._thread_info {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:36:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread count: 28 {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 08:36:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread info: [<_MainThread(MainThread, started 138934582050944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 08:36:31 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b145a5d7-46b1-4cf4-920e-c60663fb1312 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47.7b8e6655-eb17-474d-a82d-8fea2071eb69" returned: 0 in 0.300s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:31 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-b145a5d7-46b1-4cf4-920e-c60663fb1312 tempest-ProjectMemberTests-966986526 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47.7b8e6655-eb17-474d-a82d-8fea2071eb69 is being set with open permissions: ugo+rw Sep 01 08:36:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b145a5d7-46b1-4cf4-920e-c60663fb1312 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47.7b8e6655-eb17-474d-a82d-8fea2071eb69 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:31 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47.7b8e6655-eb17-474d-a82d-8fea2071eb69 Sep 01 08:36:31 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:31 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b145a5d7-46b1-4cf4-920e-c60663fb1312 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47.7b8e6655-eb17-474d-a82d-8fea2071eb69" returned: 0 in 0.255s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b145a5d7-46b1-4cf4-920e-c60663fb1312 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:31 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47.info Sep 01 08:36:31 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:31 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b145a5d7-46b1-4cf4-920e-c60663fb1312 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47.info" returned: 0 in 0.253s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:31 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-b145a5d7-46b1-4cf4-920e-c60663fb1312 tempest-ProjectMemberTests-966986526 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47.info is being set with open permissions: ugo+rw Sep 01 08:36:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b145a5d7-46b1-4cf4-920e-c60663fb1312 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:31 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47.info Sep 01 08:36:31 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:32 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b145a5d7-46b1-4cf4-920e-c60663fb1312 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47.info" returned: 0 in 0.248s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b145a5d7-46b1-4cf4-920e-c60663fb1312 tempest-ProjectMemberTests-966986526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.875s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:36:32 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-b145a5d7-46b1-4cf4-920e-c60663fb1312 tempest-ProjectMemberTests-966986526 None] Create snapshot completed successfully Sep 01 08:36:32 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ed45a38a-0d00-4514-9603-765185a18283 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-7b8e6655-eb17-474d-a82d-8fea2071eb69-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:32 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ed45a38a-0d00-4514-9603-765185a18283 tempest-ProjectMemberTests-966986526 None] Lock "cinder-7b8e6655-eb17-474d-a82d-8fea2071eb69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:32 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ed45a38a-0d00-4514-9603-765185a18283 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-quobyte-2c1a9dd2-eef3-49bd-9c0d-23835b643c47" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:32 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ed45a38a-0d00-4514-9603-765185a18283 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-2c1a9dd2-eef3-49bd-9c0d-23835b643c47" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:32 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ed45a38a-0d00-4514-9603-765185a18283 tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-quobyte-7b8e6655-eb17-474d-a82d-8fea2071eb69" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:32 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ed45a38a-0d00-4514-9603-765185a18283 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-7b8e6655-eb17-474d-a82d-8fea2071eb69" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:32 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-ed45a38a-0d00-4514-9603-765185a18283 tempest-ProjectMemberTests-966986526 None] Deleting offline snapshot 7b8e6655-eb17-474d-a82d-8fea2071eb69 of volume 2c1a9dd2-eef3-49bd-9c0d-23835b643c47 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:36:32 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-ed45a38a-0d00-4514-9603-765185a18283 tempest-ProjectMemberTests-966986526 None] snapshot_file for this snap is: volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47.7b8e6655-eb17-474d-a82d-8fea2071eb69 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:36:32 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe9e398-2eac-4da9-94f6-482b9dc5cca1]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:32 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ed45a38a-0d00-4514-9603-765185a18283 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47.7b8e6655-eb17-474d-a82d-8fea2071eb69 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:32 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47.7b8e6655-eb17-474d-a82d-8fea2071eb69 Sep 01 08:36:32 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:33 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ed45a38a-0d00-4514-9603-765185a18283 tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47.7b8e6655-eb17-474d-a82d-8fea2071eb69" returned: 0 in 0.353s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:33 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-ed45a38a-0d00-4514-9603-765185a18283 tempest-ProjectMemberTests-966986526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:36:33 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[7344c2d8-2755-4c47-8253-60d605d8ffdd]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ed45a38a-0d00-4514-9603-765185a18283 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:33 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47 Sep 01 08:36:33 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:33 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ed45a38a-0d00-4514-9603-765185a18283 tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47" returned: 0 in 0.352s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ed45a38a-0d00-4514-9603-765185a18283 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47.7b8e6655-eb17-474d-a82d-8fea2071eb69 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:33 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47.7b8e6655-eb17-474d-a82d-8fea2071eb69 Sep 01 08:36:33 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:33 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ed45a38a-0d00-4514-9603-765185a18283 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47.7b8e6655-eb17-474d-a82d-8fea2071eb69" returned: 0 in 0.327s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ed45a38a-0d00-4514-9603-765185a18283 tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47.7b8e6655-eb17-474d-a82d-8fea2071eb69 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:33 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47.7b8e6655-eb17-474d-a82d-8fea2071eb69 Sep 01 08:36:33 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:33 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:33 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ed45a38a-0d00-4514-9603-765185a18283 tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47.7b8e6655-eb17-474d-a82d-8fea2071eb69" returned: 0 in 0.241s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ed45a38a-0d00-4514-9603-765185a18283 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-7b8e6655-eb17-474d-a82d-8fea2071eb69" released by "_delete_snapshot" :: held 1.354s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:33 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ed45a38a-0d00-4514-9603-765185a18283 tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-2c1a9dd2-eef3-49bd-9c0d-23835b643c47" released by "delete_snapshot" :: held 1.374s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:34 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-ed45a38a-0d00-4514-9603-765185a18283 tempest-ProjectMemberTests-966986526 None] Created reservations ['f091d760-da04-40e9-9ffd-40e000445499', '5470bed0-e095-40e7-a048-6cf568bf5422', '9ab8cb89-4059-45e6-b343-7c5c665b7a4f', '04bf98df-d701-4267-bb2b-9f790419ce1d'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:36:34 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-ed45a38a-0d00-4514-9603-765185a18283 tempest-ProjectMemberTests-966986526 None] Delete snapshot completed successfully. Sep 01 08:36:34 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-ed45a38a-0d00-4514-9603-765185a18283 tempest-ProjectMemberTests-966986526 None] Lock "cinder-7b8e6655-eb17-474d-a82d-8fea2071eb69-delete_snapshot" released by "delete_snapshot" :: held 1.501s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:34 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-01abcc8b-896e-4ed9-8bc3-16550afba50e tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-2c1a9dd2-eef3-49bd-9c0d-23835b643c47-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:34 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-01abcc8b-896e-4ed9-8bc3-16550afba50e tempest-ProjectMemberTests-966986526 None] Lock "cinder-2c1a9dd2-eef3-49bd-9c0d-23835b643c47-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:34 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-01abcc8b-896e-4ed9-8bc3-16550afba50e tempest-ProjectMemberTests-966986526 None] Acquiring lock "cinder-quobyte-2c1a9dd2-eef3-49bd-9c0d-23835b643c47" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:34 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-01abcc8b-896e-4ed9-8bc3-16550afba50e tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-2c1a9dd2-eef3-49bd-9c0d-23835b643c47" acquired by "delete_volume" :: waited 0.016s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:34 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[608b0e63-e75c-4ba1-b1af-20c600392052]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:34 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01abcc8b-896e-4ed9-8bc3-16550afba50e tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:34 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47 Sep 01 08:36:34 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:35 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01abcc8b-896e-4ed9-8bc3-16550afba50e tempest-ProjectMemberTests-966986526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47" returned: 0 in 0.350s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01abcc8b-896e-4ed9-8bc3-16550afba50e tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:35 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47 Sep 01 08:36:35 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:35 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01abcc8b-896e-4ed9-8bc3-16550afba50e tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-2c1a9dd2-eef3-49bd-9c0d-23835b643c47" returned: 0 in 0.244s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-01abcc8b-896e-4ed9-8bc3-16550afba50e tempest-ProjectMemberTests-966986526 None] Lock "cinder-quobyte-2c1a9dd2-eef3-49bd-9c0d-23835b643c47" released by "delete_volume" :: held 0.650s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:35 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-01abcc8b-896e-4ed9-8bc3-16550afba50e tempest-ProjectMemberTests-966986526 None] Created reservations ['f1ebdb1e-f632-4104-98e8-6c613896025e', '3c148c3a-b7bf-47a7-8830-94b55a9f21b5', 'bc9537c7-5e45-4525-a8ba-4ca9b009fd8e', '3a9cbb9b-9083-4432-8856-c6a592c25902'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:36:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-01abcc8b-896e-4ed9-8bc3-16550afba50e tempest-ProjectMemberTests-966986526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:36:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-01abcc8b-896e-4ed9-8bc3-16550afba50e tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:36:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-01abcc8b-896e-4ed9-8bc3-16550afba50e tempest-ProjectMemberTests-966986526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:36:35 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-01abcc8b-896e-4ed9-8bc3-16550afba50e tempest-ProjectMemberTests-966986526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:36:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-01abcc8b-896e-4ed9-8bc3-16550afba50e tempest-ProjectMemberTests-966986526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:36:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01abcc8b-896e-4ed9-8bc3-16550afba50e tempest-ProjectMemberTests-966986526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:35 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:36:35 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:35 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:35 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-01abcc8b-896e-4ed9-8bc3-16550afba50e tempest-ProjectMemberTests-966986526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.245s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:35 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-01abcc8b-896e-4ed9-8bc3-16550afba50e tempest-ProjectMemberTests-966986526 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:36:35 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-01abcc8b-896e-4ed9-8bc3-16550afba50e tempest-ProjectMemberTests-966986526 None] Deleted volume successfully. Sep 01 08:36:35 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-01abcc8b-896e-4ed9-8bc3-16550afba50e tempest-ProjectMemberTests-966986526 None] Lock "cinder-2c1a9dd2-eef3-49bd-9c0d-23835b643c47-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:39 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:36:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] Flow 'volume_create_manager' (f7253a25-f560-4d8c-a3ee-5eb42da46333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:36:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70bc8bfc-876a-4baf-bbbf-0892a730ab1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70bc8bfc-876a-4baf-bbbf-0892a730ab1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-467823796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=876c44e2-c2e8-4601-b329-173368821977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a60627e84a3145989582c813068c707c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:36:39Z,use_quota=True,user_id='34043a6150e84bed87fae68c61152ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ef65cf-7c8b-45dd-a85c-fc4a0f7160e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ef65cf-7c8b-45dd-a85c-fc4a0f7160e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (994e4e64-1e7a-4e1e-be10-0bd2ad7877ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (994e4e64-1e7a-4e1e-be10-0bd2ad7877ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '876c44e2-c2e8-4601-b329-173368821977', 'volume_name': 'volume-876c44e2-c2e8-4601-b329-173368821977', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63712c2a-c54f-4131-8e28-ad0ca63ccf04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63712c2a-c54f-4131-8e28-ad0ca63ccf04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:39 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac25440f-3ae8-40f1-8954-1ed15cef8af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:39 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] Volume 876c44e2-c2e8-4601-b329-173368821977: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-876c44e2-c2e8-4601-b329-173368821977', 'volume_size': 1} Sep 01 08:36:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:36:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:36:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-467823796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=876c44e2-c2e8-4601-b329-173368821977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a60627e84a3145989582c813068c707c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:36:39Z,use_quota=True,user_id='34043a6150e84bed87fae68c61152ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:36:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] Creating volume 876c44e2-c2e8-4601-b329-173368821977 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:36:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:36:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:36:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:36:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:36:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:36:39 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:36:39 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:36:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:39 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977 1073741824 Sep 01 08:36:39 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:39 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977 1073741824" returned: 0 in 0.396s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:39 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:40 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977 Sep 01 08:36:40 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:40 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977" returned: 0 in 0.243s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:40 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:36:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:36:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac25440f-3ae8-40f1-8954-1ed15cef8af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-876c44e2-c2e8-4601-b329-173368821977', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7fd2d28-9513-4d35-93b1-03687bc8bb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:40 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] Volume volume-876c44e2-c2e8-4601-b329-173368821977 (876c44e2-c2e8-4601-b329-173368821977): created successfully Sep 01 08:36:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7fd2d28-9513-4d35-93b1-03687bc8bb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:40 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] Flow 'volume_create_manager' (f7253a25-f560-4d8c-a3ee-5eb42da46333) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:36:40 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-bd0f864e-d355-4f5e-aeac-8d45558d2ae1 tempest-ProjectReaderTests-991897247 None] Created volume successfully. Sep 01 08:36:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c176d2b7-70b0-47bf-b3d9-bc2b54b44183 tempest-ProjectReaderTests-991897247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:36:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c176d2b7-70b0-47bf-b3d9-bc2b54b44183 tempest-ProjectReaderTests-991897247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:36:40 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-c176d2b7-70b0-47bf-b3d9-bc2b54b44183 tempest-ProjectReaderTests-991897247 None] Creating offline snapshot 087509ac-2d37-4d5a-8392-77542c17df6c of volume 876c44e2-c2e8-4601-b329-173368821977 {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:36:40 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2a7fb7-fd6a-4066-9980-2697570255ba]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:40 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c176d2b7-70b0-47bf-b3d9-bc2b54b44183 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:40 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977 Sep 01 08:36:40 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:41 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c176d2b7-70b0-47bf-b3d9-bc2b54b44183 tempest-ProjectReaderTests-991897247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977" returned: 0 in 0.354s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c176d2b7-70b0-47bf-b3d9-bc2b54b44183 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977.087509ac-2d37-4d5a-8392-77542c17df6c 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:41 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977.087509ac-2d37-4d5a-8392-77542c17df6c 1G Sep 01 08:36:41 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:41 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c176d2b7-70b0-47bf-b3d9-bc2b54b44183 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977.087509ac-2d37-4d5a-8392-77542c17df6c 1G" returned: 0 in 0.385s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c176d2b7-70b0-47bf-b3d9-bc2b54b44183 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-876c44e2-c2e8-4601-b329-173368821977 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977.087509ac-2d37-4d5a-8392-77542c17df6c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:41 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-876c44e2-c2e8-4601-b329-173368821977 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977.087509ac-2d37-4d5a-8392-77542c17df6c Sep 01 08:36:41 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:41 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c176d2b7-70b0-47bf-b3d9-bc2b54b44183 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-876c44e2-c2e8-4601-b329-173368821977 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977.087509ac-2d37-4d5a-8392-77542c17df6c" returned: 0 in 0.301s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:41 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-c176d2b7-70b0-47bf-b3d9-bc2b54b44183 tempest-ProjectReaderTests-991897247 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977.087509ac-2d37-4d5a-8392-77542c17df6c is being set with open permissions: ugo+rw Sep 01 08:36:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c176d2b7-70b0-47bf-b3d9-bc2b54b44183 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977.087509ac-2d37-4d5a-8392-77542c17df6c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:41 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977.087509ac-2d37-4d5a-8392-77542c17df6c Sep 01 08:36:41 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:41 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c176d2b7-70b0-47bf-b3d9-bc2b54b44183 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977.087509ac-2d37-4d5a-8392-77542c17df6c" returned: 0 in 0.245s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:41 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c176d2b7-70b0-47bf-b3d9-bc2b54b44183 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:42 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977.info Sep 01 08:36:42 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:42 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c176d2b7-70b0-47bf-b3d9-bc2b54b44183 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977.info" returned: 0 in 0.251s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:42 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-c176d2b7-70b0-47bf-b3d9-bc2b54b44183 tempest-ProjectReaderTests-991897247 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977.info is being set with open permissions: ugo+rw Sep 01 08:36:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c176d2b7-70b0-47bf-b3d9-bc2b54b44183 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:42 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977.info Sep 01 08:36:42 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:42 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-c176d2b7-70b0-47bf-b3d9-bc2b54b44183 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977.info" returned: 0 in 0.261s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-c176d2b7-70b0-47bf-b3d9-bc2b54b44183 tempest-ProjectReaderTests-991897247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.876s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:36:42 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-c176d2b7-70b0-47bf-b3d9-bc2b54b44183 tempest-ProjectReaderTests-991897247 None] Create snapshot completed successfully Sep 01 08:36:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-07170b43-4cf4-4fca-ad5d-dab9b836ee06 tempest-ProjectReaderTests-991897247 None] Acquiring lock "cinder-087509ac-2d37-4d5a-8392-77542c17df6c-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-07170b43-4cf4-4fca-ad5d-dab9b836ee06 tempest-ProjectReaderTests-991897247 None] Lock "cinder-087509ac-2d37-4d5a-8392-77542c17df6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-07170b43-4cf4-4fca-ad5d-dab9b836ee06 tempest-ProjectReaderTests-991897247 None] Acquiring lock "cinder-quobyte-876c44e2-c2e8-4601-b329-173368821977" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-07170b43-4cf4-4fca-ad5d-dab9b836ee06 tempest-ProjectReaderTests-991897247 None] Lock "cinder-quobyte-876c44e2-c2e8-4601-b329-173368821977" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-07170b43-4cf4-4fca-ad5d-dab9b836ee06 tempest-ProjectReaderTests-991897247 None] Acquiring lock "cinder-quobyte-087509ac-2d37-4d5a-8392-77542c17df6c" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:42 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-07170b43-4cf4-4fca-ad5d-dab9b836ee06 tempest-ProjectReaderTests-991897247 None] Lock "cinder-quobyte-087509ac-2d37-4d5a-8392-77542c17df6c" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-07170b43-4cf4-4fca-ad5d-dab9b836ee06 tempest-ProjectReaderTests-991897247 None] Deleting offline snapshot 087509ac-2d37-4d5a-8392-77542c17df6c of volume 876c44e2-c2e8-4601-b329-173368821977 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:36:42 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-07170b43-4cf4-4fca-ad5d-dab9b836ee06 tempest-ProjectReaderTests-991897247 None] snapshot_file for this snap is: volume-876c44e2-c2e8-4601-b329-173368821977.087509ac-2d37-4d5a-8392-77542c17df6c {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:36:42 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[6558e09b-3c6d-4ebb-835d-3891feaa9640]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:42 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-07170b43-4cf4-4fca-ad5d-dab9b836ee06 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977.087509ac-2d37-4d5a-8392-77542c17df6c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:43 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977.087509ac-2d37-4d5a-8392-77542c17df6c Sep 01 08:36:43 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:43 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-07170b43-4cf4-4fca-ad5d-dab9b836ee06 tempest-ProjectReaderTests-991897247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977.087509ac-2d37-4d5a-8392-77542c17df6c" returned: 0 in 0.351s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:43 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-07170b43-4cf4-4fca-ad5d-dab9b836ee06 tempest-ProjectReaderTests-991897247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-876c44e2-c2e8-4601-b329-173368821977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:36:43 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[4444128f-8438-4e62-aadd-ab7f973b89d1]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-07170b43-4cf4-4fca-ad5d-dab9b836ee06 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:43 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977 Sep 01 08:36:43 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:43 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-07170b43-4cf4-4fca-ad5d-dab9b836ee06 tempest-ProjectReaderTests-991897247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977" returned: 0 in 0.351s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:43 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-07170b43-4cf4-4fca-ad5d-dab9b836ee06 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977.087509ac-2d37-4d5a-8392-77542c17df6c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:43 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977.087509ac-2d37-4d5a-8392-77542c17df6c Sep 01 08:36:43 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:44 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-07170b43-4cf4-4fca-ad5d-dab9b836ee06 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977.087509ac-2d37-4d5a-8392-77542c17df6c" returned: 0 in 0.324s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-07170b43-4cf4-4fca-ad5d-dab9b836ee06 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977.087509ac-2d37-4d5a-8392-77542c17df6c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:44 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977.087509ac-2d37-4d5a-8392-77542c17df6c Sep 01 08:36:44 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:44 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:44 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-07170b43-4cf4-4fca-ad5d-dab9b836ee06 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977.087509ac-2d37-4d5a-8392-77542c17df6c" returned: 0 in 0.245s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:44 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-07170b43-4cf4-4fca-ad5d-dab9b836ee06 tempest-ProjectReaderTests-991897247 None] Lock "cinder-quobyte-087509ac-2d37-4d5a-8392-77542c17df6c" released by "_delete_snapshot" :: held 1.349s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:44 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-07170b43-4cf4-4fca-ad5d-dab9b836ee06 tempest-ProjectReaderTests-991897247 None] Lock "cinder-quobyte-876c44e2-c2e8-4601-b329-173368821977" released by "delete_snapshot" :: held 1.370s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:44 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-07170b43-4cf4-4fca-ad5d-dab9b836ee06 tempest-ProjectReaderTests-991897247 None] Created reservations ['e8ef209a-af40-4c42-8d31-edde7226dba9', '64fa3cbe-bdd7-4a70-bf35-a01a02f2d1ab', '31565541-e906-4ec7-8964-855048d429a1', 'd1067b91-0e9d-47b6-ba84-3a46db7c4a02'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:36:44 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-07170b43-4cf4-4fca-ad5d-dab9b836ee06 tempest-ProjectReaderTests-991897247 None] Delete snapshot completed successfully. Sep 01 08:36:44 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-07170b43-4cf4-4fca-ad5d-dab9b836ee06 tempest-ProjectReaderTests-991897247 None] Lock "cinder-087509ac-2d37-4d5a-8392-77542c17df6c-delete_snapshot" released by "delete_snapshot" :: held 1.498s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:45 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8abffafc-c354-409f-97e2-53337cd4d51e tempest-ProjectReaderTests-991897247 None] Acquiring lock "cinder-876c44e2-c2e8-4601-b329-173368821977-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:45 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8abffafc-c354-409f-97e2-53337cd4d51e tempest-ProjectReaderTests-991897247 None] Lock "cinder-876c44e2-c2e8-4601-b329-173368821977-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:45 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8abffafc-c354-409f-97e2-53337cd4d51e tempest-ProjectReaderTests-991897247 None] Acquiring lock "cinder-quobyte-876c44e2-c2e8-4601-b329-173368821977" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:45 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8abffafc-c354-409f-97e2-53337cd4d51e tempest-ProjectReaderTests-991897247 None] Lock "cinder-quobyte-876c44e2-c2e8-4601-b329-173368821977" acquired by "delete_volume" :: waited 0.015s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:45 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[be13a8d2-8f19-4853-bd0b-45353c5bb1e0]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8abffafc-c354-409f-97e2-53337cd4d51e tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:45 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977 Sep 01 08:36:45 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:45 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8abffafc-c354-409f-97e2-53337cd4d51e tempest-ProjectReaderTests-991897247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977" returned: 0 in 0.357s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8abffafc-c354-409f-97e2-53337cd4d51e tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:45 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977 Sep 01 08:36:45 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:45 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8abffafc-c354-409f-97e2-53337cd4d51e tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-876c44e2-c2e8-4601-b329-173368821977" returned: 0 in 0.247s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:45 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8abffafc-c354-409f-97e2-53337cd4d51e tempest-ProjectReaderTests-991897247 None] Lock "cinder-quobyte-876c44e2-c2e8-4601-b329-173368821977" released by "delete_volume" :: held 0.657s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:45 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-8abffafc-c354-409f-97e2-53337cd4d51e tempest-ProjectReaderTests-991897247 None] Created reservations ['53d9bac3-edb0-4dd1-90cb-5a7a60740cb3', 'd21a0bb1-b29e-4a7c-ab62-0a708d2009fe', '7c14604d-a550-48ec-bab0-002f31375dcf', 'a65fb98f-dd28-4770-9c1f-70f529e63222'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:36:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8abffafc-c354-409f-97e2-53337cd4d51e tempest-ProjectReaderTests-991897247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:36:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8abffafc-c354-409f-97e2-53337cd4d51e tempest-ProjectReaderTests-991897247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:36:45 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8abffafc-c354-409f-97e2-53337cd4d51e tempest-ProjectReaderTests-991897247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:36:45 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-8abffafc-c354-409f-97e2-53337cd4d51e tempest-ProjectReaderTests-991897247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:36:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-8abffafc-c354-409f-97e2-53337cd4d51e tempest-ProjectReaderTests-991897247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:36:45 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8abffafc-c354-409f-97e2-53337cd4d51e tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:45 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:36:45 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:46 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-8abffafc-c354-409f-97e2-53337cd4d51e tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.261s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:46 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-8abffafc-c354-409f-97e2-53337cd4d51e tempest-ProjectReaderTests-991897247 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:36:46 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-8abffafc-c354-409f-97e2-53337cd4d51e tempest-ProjectReaderTests-991897247 None] Deleted volume successfully. Sep 01 08:36:46 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-8abffafc-c354-409f-97e2-53337cd4d51e tempest-ProjectReaderTests-991897247 None] Lock "cinder-876c44e2-c2e8-4601-b329-173368821977-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:46 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:36:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] Flow 'volume_create_manager' (b9be9aa3-fd52-457c-bf6a-63c84363c754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:36:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b3d74b-cd2c-45a5-820d-6e177bad1916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b3d74b-cd2c-45a5-820d-6e177bad1916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1983975263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d2db98-22cb-4bb8-a40e-ce349ed84197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a60627e84a3145989582c813068c707c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:36:47Z,use_quota=True,user_id='34043a6150e84bed87fae68c61152ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (979c7212-6c6e-487e-94c3-ba6b23b8612c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (979c7212-6c6e-487e-94c3-ba6b23b8612c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6648102e-5ea7-4dc1-bc67-0d4ead38ac02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6648102e-5ea7-4dc1-bc67-0d4ead38ac02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9d2db98-22cb-4bb8-a40e-ce349ed84197', 'volume_name': 'volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c3752e1-862e-4eaf-bf07-d45956bfe014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c3752e1-862e-4eaf-bf07-d45956bfe014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:46 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c73bd06-bf9f-4945-980d-80902eca665b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:46 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] Volume e9d2db98-22cb-4bb8-a40e-ce349ed84197: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197', 'volume_size': 1} Sep 01 08:36:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:36:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:36:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1983975263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d2db98-22cb-4bb8-a40e-ce349ed84197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a60627e84a3145989582c813068c707c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:36:47Z,use_quota=True,user_id='34043a6150e84bed87fae68c61152ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:36:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] Creating volume e9d2db98-22cb-4bb8-a40e-ce349ed84197 {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:36:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:36:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:36:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:36:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:36:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:36:46 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:36:46 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:36:46 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:46 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197 1073741824 Sep 01 08:36:46 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:47 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197 1073741824" returned: 0 in 0.401s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:47 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197 Sep 01 08:36:47 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:47 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197" returned: 0 in 0.252s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:36:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:36:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c73bd06-bf9f-4945-980d-80902eca665b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (812b4bfd-505e-40aa-ba3a-10bdd39d8a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:47 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] Volume volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197 (e9d2db98-22cb-4bb8-a40e-ce349ed84197): created successfully Sep 01 08:36:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (812b4bfd-505e-40aa-ba3a-10bdd39d8a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:47 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] Flow 'volume_create_manager' (b9be9aa3-fd52-457c-bf6a-63c84363c754) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:36:47 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-bc886202-1d45-4cd6-8151-6435e6b5fa49 tempest-ProjectReaderTests-991897247 None] Created volume successfully. Sep 01 08:36:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0f3dd3fd-3df9-4323-abcf-005b260ab8b0 tempest-ProjectReaderTests-991897247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:36:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0f3dd3fd-3df9-4323-abcf-005b260ab8b0 tempest-ProjectReaderTests-991897247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:36:47 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-0f3dd3fd-3df9-4323-abcf-005b260ab8b0 tempest-ProjectReaderTests-991897247 None] Creating offline snapshot bc8990ab-b859-417f-ab31-71b17cb5845c of volume e9d2db98-22cb-4bb8-a40e-ce349ed84197 {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:36:47 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[c263bf67-63a8-47d4-b492-dbb630e37ae5]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:47 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0f3dd3fd-3df9-4323-abcf-005b260ab8b0 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:47 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197 Sep 01 08:36:47 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:48 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0f3dd3fd-3df9-4323-abcf-005b260ab8b0 tempest-ProjectReaderTests-991897247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197" returned: 0 in 0.359s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0f3dd3fd-3df9-4323-abcf-005b260ab8b0 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197.bc8990ab-b859-417f-ab31-71b17cb5845c 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:48 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197.bc8990ab-b859-417f-ab31-71b17cb5845c 1G Sep 01 08:36:48 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:48 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0f3dd3fd-3df9-4323-abcf-005b260ab8b0 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197.bc8990ab-b859-417f-ab31-71b17cb5845c 1G" returned: 0 in 0.378s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0f3dd3fd-3df9-4323-abcf-005b260ab8b0 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197.bc8990ab-b859-417f-ab31-71b17cb5845c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:48 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197.bc8990ab-b859-417f-ab31-71b17cb5845c Sep 01 08:36:48 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:48 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0f3dd3fd-3df9-4323-abcf-005b260ab8b0 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197 -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197.bc8990ab-b859-417f-ab31-71b17cb5845c" returned: 0 in 0.283s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:48 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-0f3dd3fd-3df9-4323-abcf-005b260ab8b0 tempest-ProjectReaderTests-991897247 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197.bc8990ab-b859-417f-ab31-71b17cb5845c is being set with open permissions: ugo+rw Sep 01 08:36:48 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0f3dd3fd-3df9-4323-abcf-005b260ab8b0 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197.bc8990ab-b859-417f-ab31-71b17cb5845c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:48 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197.bc8990ab-b859-417f-ab31-71b17cb5845c Sep 01 08:36:48 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:49 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0f3dd3fd-3df9-4323-abcf-005b260ab8b0 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197.bc8990ab-b859-417f-ab31-71b17cb5845c" returned: 0 in 0.246s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0f3dd3fd-3df9-4323-abcf-005b260ab8b0 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:49 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197.info Sep 01 08:36:49 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:49 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0f3dd3fd-3df9-4323-abcf-005b260ab8b0 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197.info" returned: 0 in 0.250s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:49 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-0f3dd3fd-3df9-4323-abcf-005b260ab8b0 tempest-ProjectReaderTests-991897247 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197.info is being set with open permissions: ugo+rw Sep 01 08:36:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0f3dd3fd-3df9-4323-abcf-005b260ab8b0 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:49 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197.info Sep 01 08:36:49 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:49 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0f3dd3fd-3df9-4323-abcf-005b260ab8b0 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197.info" returned: 0 in 0.246s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0f3dd3fd-3df9-4323-abcf-005b260ab8b0 tempest-ProjectReaderTests-991897247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.836s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:36:49 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-0f3dd3fd-3df9-4323-abcf-005b260ab8b0 tempest-ProjectReaderTests-991897247 None] Create snapshot completed successfully Sep 01 08:36:49 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-cdb8f47d-523a-4972-b31b-d7be2e9dc38d tempest-ProjectReaderTests-991897247 None] Acquiring lock "cinder-bc8990ab-b859-417f-ab31-71b17cb5845c-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:49 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-cdb8f47d-523a-4972-b31b-d7be2e9dc38d tempest-ProjectReaderTests-991897247 None] Lock "cinder-bc8990ab-b859-417f-ab31-71b17cb5845c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:49 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-cdb8f47d-523a-4972-b31b-d7be2e9dc38d tempest-ProjectReaderTests-991897247 None] Acquiring lock "cinder-quobyte-e9d2db98-22cb-4bb8-a40e-ce349ed84197" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:49 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-cdb8f47d-523a-4972-b31b-d7be2e9dc38d tempest-ProjectReaderTests-991897247 None] Lock "cinder-quobyte-e9d2db98-22cb-4bb8-a40e-ce349ed84197" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:49 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-cdb8f47d-523a-4972-b31b-d7be2e9dc38d tempest-ProjectReaderTests-991897247 None] Acquiring lock "cinder-quobyte-bc8990ab-b859-417f-ab31-71b17cb5845c" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:49 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-cdb8f47d-523a-4972-b31b-d7be2e9dc38d tempest-ProjectReaderTests-991897247 None] Lock "cinder-quobyte-bc8990ab-b859-417f-ab31-71b17cb5845c" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:49 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-cdb8f47d-523a-4972-b31b-d7be2e9dc38d tempest-ProjectReaderTests-991897247 None] Deleting offline snapshot bc8990ab-b859-417f-ab31-71b17cb5845c of volume e9d2db98-22cb-4bb8-a40e-ce349ed84197 {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:36:49 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-cdb8f47d-523a-4972-b31b-d7be2e9dc38d tempest-ProjectReaderTests-991897247 None] snapshot_file for this snap is: volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197.bc8990ab-b859-417f-ab31-71b17cb5845c {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:36:49 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46e947a-4ba7-4bbe-a57e-8d9971587d67]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:49 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cdb8f47d-523a-4972-b31b-d7be2e9dc38d tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197.bc8990ab-b859-417f-ab31-71b17cb5845c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:50 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197.bc8990ab-b859-417f-ab31-71b17cb5845c Sep 01 08:36:50 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:50 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cdb8f47d-523a-4972-b31b-d7be2e9dc38d tempest-ProjectReaderTests-991897247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197.bc8990ab-b859-417f-ab31-71b17cb5845c" returned: 0 in 0.349s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:50 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-cdb8f47d-523a-4972-b31b-d7be2e9dc38d tempest-ProjectReaderTests-991897247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:36:50 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04062b9-d801-46ae-800c-5d870aa15fbf]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cdb8f47d-523a-4972-b31b-d7be2e9dc38d tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:50 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197 Sep 01 08:36:50 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:50 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cdb8f47d-523a-4972-b31b-d7be2e9dc38d tempest-ProjectReaderTests-991897247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197" returned: 0 in 0.365s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:50 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cdb8f47d-523a-4972-b31b-d7be2e9dc38d tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197.bc8990ab-b859-417f-ab31-71b17cb5845c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:50 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197.bc8990ab-b859-417f-ab31-71b17cb5845c Sep 01 08:36:50 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:51 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cdb8f47d-523a-4972-b31b-d7be2e9dc38d tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197.bc8990ab-b859-417f-ab31-71b17cb5845c" returned: 0 in 0.327s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cdb8f47d-523a-4972-b31b-d7be2e9dc38d tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197.bc8990ab-b859-417f-ab31-71b17cb5845c {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:51 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197.bc8990ab-b859-417f-ab31-71b17cb5845c Sep 01 08:36:51 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:51 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:51 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-cdb8f47d-523a-4972-b31b-d7be2e9dc38d tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197.bc8990ab-b859-417f-ab31-71b17cb5845c" returned: 0 in 0.245s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:51 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-cdb8f47d-523a-4972-b31b-d7be2e9dc38d tempest-ProjectReaderTests-991897247 None] Lock "cinder-quobyte-bc8990ab-b859-417f-ab31-71b17cb5845c" released by "_delete_snapshot" :: held 1.367s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:51 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-cdb8f47d-523a-4972-b31b-d7be2e9dc38d tempest-ProjectReaderTests-991897247 None] Lock "cinder-quobyte-e9d2db98-22cb-4bb8-a40e-ce349ed84197" released by "delete_snapshot" :: held 1.386s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:51 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-cdb8f47d-523a-4972-b31b-d7be2e9dc38d tempest-ProjectReaderTests-991897247 None] Created reservations ['a7577ad8-40ff-4c99-8b5f-79308b313e4e', '7ab846db-5bcb-4fee-ad4e-0a2baac3b983', 'c53dba79-cec8-4e7a-949b-18988e606234', '98560975-051a-4b7e-bae9-89d8a46cfcbf'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:36:51 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-cdb8f47d-523a-4972-b31b-d7be2e9dc38d tempest-ProjectReaderTests-991897247 None] Delete snapshot completed successfully. Sep 01 08:36:51 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-cdb8f47d-523a-4972-b31b-d7be2e9dc38d tempest-ProjectReaderTests-991897247 None] Lock "cinder-bc8990ab-b859-417f-ab31-71b17cb5845c-delete_snapshot" released by "delete_snapshot" :: held 1.507s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:52 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b26f79c6-3afe-44d0-b9b6-2bcbfe026a64 tempest-ProjectReaderTests-991897247 None] Acquiring lock "cinder-e9d2db98-22cb-4bb8-a40e-ce349ed84197-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:52 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b26f79c6-3afe-44d0-b9b6-2bcbfe026a64 tempest-ProjectReaderTests-991897247 None] Lock "cinder-e9d2db98-22cb-4bb8-a40e-ce349ed84197-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:52 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b26f79c6-3afe-44d0-b9b6-2bcbfe026a64 tempest-ProjectReaderTests-991897247 None] Acquiring lock "cinder-quobyte-e9d2db98-22cb-4bb8-a40e-ce349ed84197" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:52 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b26f79c6-3afe-44d0-b9b6-2bcbfe026a64 tempest-ProjectReaderTests-991897247 None] Lock "cinder-quobyte-e9d2db98-22cb-4bb8-a40e-ce349ed84197" acquired by "delete_volume" :: waited 0.014s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:52 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c2adb0-3845-464f-b9ac-164d49d21ef2]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b26f79c6-3afe-44d0-b9b6-2bcbfe026a64 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:52 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197 Sep 01 08:36:52 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:52 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b26f79c6-3afe-44d0-b9b6-2bcbfe026a64 tempest-ProjectReaderTests-991897247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197" returned: 0 in 0.355s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b26f79c6-3afe-44d0-b9b6-2bcbfe026a64 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:52 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197 Sep 01 08:36:52 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:52 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b26f79c6-3afe-44d0-b9b6-2bcbfe026a64 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-e9d2db98-22cb-4bb8-a40e-ce349ed84197" returned: 0 in 0.240s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:52 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b26f79c6-3afe-44d0-b9b6-2bcbfe026a64 tempest-ProjectReaderTests-991897247 None] Lock "cinder-quobyte-e9d2db98-22cb-4bb8-a40e-ce349ed84197" released by "delete_volume" :: held 0.653s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:52 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-b26f79c6-3afe-44d0-b9b6-2bcbfe026a64 tempest-ProjectReaderTests-991897247 None] Created reservations ['e8ebbae2-b642-495f-9a92-dd7a0afad1c9', 'e8296225-963f-423b-9490-cc4728d30997', '1472ac3e-9e11-4532-b041-c52edd104231', 'cd09a2a3-41fa-487e-8866-87367c2486a0'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:36:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b26f79c6-3afe-44d0-b9b6-2bcbfe026a64 tempest-ProjectReaderTests-991897247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:36:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b26f79c6-3afe-44d0-b9b6-2bcbfe026a64 tempest-ProjectReaderTests-991897247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:36:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b26f79c6-3afe-44d0-b9b6-2bcbfe026a64 tempest-ProjectReaderTests-991897247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:36:52 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-b26f79c6-3afe-44d0-b9b6-2bcbfe026a64 tempest-ProjectReaderTests-991897247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:36:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-b26f79c6-3afe-44d0-b9b6-2bcbfe026a64 tempest-ProjectReaderTests-991897247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:36:52 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b26f79c6-3afe-44d0-b9b6-2bcbfe026a64 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:52 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:36:52 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:53 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-b26f79c6-3afe-44d0-b9b6-2bcbfe026a64 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.246s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:53 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-b26f79c6-3afe-44d0-b9b6-2bcbfe026a64 tempest-ProjectReaderTests-991897247 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:36:53 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-b26f79c6-3afe-44d0-b9b6-2bcbfe026a64 tempest-ProjectReaderTests-991897247 None] Deleted volume successfully. Sep 01 08:36:53 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-b26f79c6-3afe-44d0-b9b6-2bcbfe026a64 tempest-ProjectReaderTests-991897247 None] Lock "cinder-e9d2db98-22cb-4bb8-a40e-ce349ed84197-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:53 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:36:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] Flow 'volume_create_manager' (ca1b7d28-3386-458b-98b6-b5e555ef30f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:36:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15f3cfd-cb0e-4f35-be60-cdab2a19df2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15f3cfd-cb0e-4f35-be60-cdab2a19df2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-314417775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=173038b7-55ee-40d0-b63e-75bd290fe6cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a60627e84a3145989582c813068c707c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:36:54Z,use_quota=True,user_id='34043a6150e84bed87fae68c61152ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df4e3fa1-286e-4c47-b42a-4ceeb8f6f4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df4e3fa1-286e-4c47-b42a-4ceeb8f6f4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d429c36-f54b-4325-ae38-3ba547170690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d429c36-f54b-4325-ae38-3ba547170690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '173038b7-55ee-40d0-b63e-75bd290fe6cc', 'volume_name': 'volume-173038b7-55ee-40d0-b63e-75bd290fe6cc', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53a3098e-b317-464d-ab01-6d733abf3cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53a3098e-b317-464d-ab01-6d733abf3cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:53 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8d72390-9cb2-4364-abbb-eae9805edc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:53 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] Volume 173038b7-55ee-40d0-b63e-75bd290fe6cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-173038b7-55ee-40d0-b63e-75bd290fe6cc', 'volume_size': 1} Sep 01 08:36:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:36:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:36:53 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-314417775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=173038b7-55ee-40d0-b63e-75bd290fe6cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a60627e84a3145989582c813068c707c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:36:54Z,use_quota=True,user_id='34043a6150e84bed87fae68c61152ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:36:53 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] Creating volume 173038b7-55ee-40d0-b63e-75bd290fe6cc {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:36:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:36:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:36:53 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:36:53 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:36:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:36:53 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:36:53 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:36:53 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:53 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc 1073741824 Sep 01 08:36:53 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:54 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc 1073741824" returned: 0 in 0.395s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:54 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc Sep 01 08:36:54 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:54 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc" returned: 0 in 0.250s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:36:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:36:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8d72390-9cb2-4364-abbb-eae9805edc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-173038b7-55ee-40d0-b63e-75bd290fe6cc', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ae0c79-1af6-4694-8257-2b44cc31b02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:36:54 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] Volume volume-173038b7-55ee-40d0-b63e-75bd290fe6cc (173038b7-55ee-40d0-b63e-75bd290fe6cc): created successfully Sep 01 08:36:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ae0c79-1af6-4694-8257-2b44cc31b02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:36:54 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] Flow 'volume_create_manager' (ca1b7d28-3386-458b-98b6-b5e555ef30f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:36:54 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-fc4cf388-acf5-4fc5-9105-94a5001fb9f2 tempest-ProjectReaderTests-991897247 None] Created volume successfully. Sep 01 08:36:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-25b3218f-b81e-4810-b5e6-8ea3bdaaa357 tempest-ProjectReaderTests-991897247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:36:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-25b3218f-b81e-4810-b5e6-8ea3bdaaa357 tempest-ProjectReaderTests-991897247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:36:54 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-25b3218f-b81e-4810-b5e6-8ea3bdaaa357 tempest-ProjectReaderTests-991897247 None] Creating offline snapshot 3c41f478-1db0-4757-81f4-253d3f8cdd4a of volume 173038b7-55ee-40d0-b63e-75bd290fe6cc {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:36:54 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efd11da-bfe2-45cc-a2ba-fc00d8dbed59]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:54 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-25b3218f-b81e-4810-b5e6-8ea3bdaaa357 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:54 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc Sep 01 08:36:54 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:55 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-25b3218f-b81e-4810-b5e6-8ea3bdaaa357 tempest-ProjectReaderTests-991897247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc" returned: 0 in 0.349s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-25b3218f-b81e-4810-b5e6-8ea3bdaaa357 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc.3c41f478-1db0-4757-81f4-253d3f8cdd4a 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:55 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc.3c41f478-1db0-4757-81f4-253d3f8cdd4a 1G Sep 01 08:36:55 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:55 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-25b3218f-b81e-4810-b5e6-8ea3bdaaa357 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc.3c41f478-1db0-4757-81f4-253d3f8cdd4a 1G" returned: 0 in 0.376s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-25b3218f-b81e-4810-b5e6-8ea3bdaaa357 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-173038b7-55ee-40d0-b63e-75bd290fe6cc -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc.3c41f478-1db0-4757-81f4-253d3f8cdd4a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:55 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-173038b7-55ee-40d0-b63e-75bd290fe6cc -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc.3c41f478-1db0-4757-81f4-253d3f8cdd4a Sep 01 08:36:55 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:55 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-25b3218f-b81e-4810-b5e6-8ea3bdaaa357 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-173038b7-55ee-40d0-b63e-75bd290fe6cc -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc.3c41f478-1db0-4757-81f4-253d3f8cdd4a" returned: 0 in 0.289s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:55 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-25b3218f-b81e-4810-b5e6-8ea3bdaaa357 tempest-ProjectReaderTests-991897247 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc.3c41f478-1db0-4757-81f4-253d3f8cdd4a is being set with open permissions: ugo+rw Sep 01 08:36:55 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-25b3218f-b81e-4810-b5e6-8ea3bdaaa357 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc.3c41f478-1db0-4757-81f4-253d3f8cdd4a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:55 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc.3c41f478-1db0-4757-81f4-253d3f8cdd4a Sep 01 08:36:55 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:56 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-25b3218f-b81e-4810-b5e6-8ea3bdaaa357 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc.3c41f478-1db0-4757-81f4-253d3f8cdd4a" returned: 0 in 0.248s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-25b3218f-b81e-4810-b5e6-8ea3bdaaa357 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:56 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc.info Sep 01 08:36:56 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:56 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-25b3218f-b81e-4810-b5e6-8ea3bdaaa357 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc.info" returned: 0 in 0.250s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:56 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-25b3218f-b81e-4810-b5e6-8ea3bdaaa357 tempest-ProjectReaderTests-991897247 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc.info is being set with open permissions: ugo+rw Sep 01 08:36:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-25b3218f-b81e-4810-b5e6-8ea3bdaaa357 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:56 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc.info Sep 01 08:36:56 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:56 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-25b3218f-b81e-4810-b5e6-8ea3bdaaa357 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc.info" returned: 0 in 0.249s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:56 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-25b3218f-b81e-4810-b5e6-8ea3bdaaa357 tempest-ProjectReaderTests-991897247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.835s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:36:56 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-25b3218f-b81e-4810-b5e6-8ea3bdaaa357 tempest-ProjectReaderTests-991897247 None] Create snapshot completed successfully Sep 01 08:36:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7edc2571-7dd1-4b1e-a100-890c3ace7993 tempest-ProjectReaderTests-991897247 None] Acquiring lock "cinder-3c41f478-1db0-4757-81f4-253d3f8cdd4a-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7edc2571-7dd1-4b1e-a100-890c3ace7993 tempest-ProjectReaderTests-991897247 None] Lock "cinder-3c41f478-1db0-4757-81f4-253d3f8cdd4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7edc2571-7dd1-4b1e-a100-890c3ace7993 tempest-ProjectReaderTests-991897247 None] Acquiring lock "cinder-quobyte-173038b7-55ee-40d0-b63e-75bd290fe6cc" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7edc2571-7dd1-4b1e-a100-890c3ace7993 tempest-ProjectReaderTests-991897247 None] Lock "cinder-quobyte-173038b7-55ee-40d0-b63e-75bd290fe6cc" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7edc2571-7dd1-4b1e-a100-890c3ace7993 tempest-ProjectReaderTests-991897247 None] Acquiring lock "cinder-quobyte-3c41f478-1db0-4757-81f4-253d3f8cdd4a" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:56 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7edc2571-7dd1-4b1e-a100-890c3ace7993 tempest-ProjectReaderTests-991897247 None] Lock "cinder-quobyte-3c41f478-1db0-4757-81f4-253d3f8cdd4a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:56 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-7edc2571-7dd1-4b1e-a100-890c3ace7993 tempest-ProjectReaderTests-991897247 None] Deleting offline snapshot 3c41f478-1db0-4757-81f4-253d3f8cdd4a of volume 173038b7-55ee-40d0-b63e-75bd290fe6cc {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:36:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-7edc2571-7dd1-4b1e-a100-890c3ace7993 tempest-ProjectReaderTests-991897247 None] snapshot_file for this snap is: volume-173038b7-55ee-40d0-b63e-75bd290fe6cc.3c41f478-1db0-4757-81f4-253d3f8cdd4a {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:36:57 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eabf7c8-9dcf-4710-a51f-22d4c425628a]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7edc2571-7dd1-4b1e-a100-890c3ace7993 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc.3c41f478-1db0-4757-81f4-253d3f8cdd4a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:57 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc.3c41f478-1db0-4757-81f4-253d3f8cdd4a Sep 01 08:36:57 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:57 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7edc2571-7dd1-4b1e-a100-890c3ace7993 tempest-ProjectReaderTests-991897247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc.3c41f478-1db0-4757-81f4-253d3f8cdd4a" returned: 0 in 0.349s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:57 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-7edc2571-7dd1-4b1e-a100-890c3ace7993 tempest-ProjectReaderTests-991897247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-173038b7-55ee-40d0-b63e-75bd290fe6cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:36:57 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a5977f-3db1-4d8b-9c8f-d2de99466be0]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7edc2571-7dd1-4b1e-a100-890c3ace7993 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:57 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc Sep 01 08:36:57 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:57 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7edc2571-7dd1-4b1e-a100-890c3ace7993 tempest-ProjectReaderTests-991897247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc" returned: 0 in 0.357s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:57 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7edc2571-7dd1-4b1e-a100-890c3ace7993 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc.3c41f478-1db0-4757-81f4-253d3f8cdd4a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:57 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc.3c41f478-1db0-4757-81f4-253d3f8cdd4a Sep 01 08:36:57 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:58 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7edc2571-7dd1-4b1e-a100-890c3ace7993 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc.3c41f478-1db0-4757-81f4-253d3f8cdd4a" returned: 0 in 0.326s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7edc2571-7dd1-4b1e-a100-890c3ace7993 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc.3c41f478-1db0-4757-81f4-253d3f8cdd4a {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:58 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc.3c41f478-1db0-4757-81f4-253d3f8cdd4a Sep 01 08:36:58 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:58 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:58 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-7edc2571-7dd1-4b1e-a100-890c3ace7993 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc.3c41f478-1db0-4757-81f4-253d3f8cdd4a" returned: 0 in 0.242s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:58 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7edc2571-7dd1-4b1e-a100-890c3ace7993 tempest-ProjectReaderTests-991897247 None] Lock "cinder-quobyte-3c41f478-1db0-4757-81f4-253d3f8cdd4a" released by "_delete_snapshot" :: held 1.357s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:58 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7edc2571-7dd1-4b1e-a100-890c3ace7993 tempest-ProjectReaderTests-991897247 None] Lock "cinder-quobyte-173038b7-55ee-40d0-b63e-75bd290fe6cc" released by "delete_snapshot" :: held 1.377s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:58 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-7edc2571-7dd1-4b1e-a100-890c3ace7993 tempest-ProjectReaderTests-991897247 None] Created reservations ['72cb719b-bd3a-4be9-b206-b6795fac4066', '46b616b8-ea37-4d9e-ab65-88105ad1409a', '4fdbfb15-31e8-460f-b02e-e9dcfabacb54', 'df3dec5a-040b-4ed5-ad5c-ebfde74c15f1'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:36:58 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-7edc2571-7dd1-4b1e-a100-890c3ace7993 tempest-ProjectReaderTests-991897247 None] Delete snapshot completed successfully. Sep 01 08:36:58 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-7edc2571-7dd1-4b1e-a100-890c3ace7993 tempest-ProjectReaderTests-991897247 None] Lock "cinder-3c41f478-1db0-4757-81f4-253d3f8cdd4a-delete_snapshot" released by "delete_snapshot" :: held 1.511s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:59 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-73247481-edb8-428f-8b06-a2370496eccd tempest-ProjectReaderTests-991897247 None] Acquiring lock "cinder-173038b7-55ee-40d0-b63e-75bd290fe6cc-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:59 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-73247481-edb8-428f-8b06-a2370496eccd tempest-ProjectReaderTests-991897247 None] Lock "cinder-173038b7-55ee-40d0-b63e-75bd290fe6cc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:59 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-73247481-edb8-428f-8b06-a2370496eccd tempest-ProjectReaderTests-991897247 None] Acquiring lock "cinder-quobyte-173038b7-55ee-40d0-b63e-75bd290fe6cc" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:36:59 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-73247481-edb8-428f-8b06-a2370496eccd tempest-ProjectReaderTests-991897247 None] Lock "cinder-quobyte-173038b7-55ee-40d0-b63e-75bd290fe6cc" acquired by "delete_volume" :: waited 0.016s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:36:59 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4501922-9d59-4e71-b862-c19fa77a723c]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:36:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-73247481-edb8-428f-8b06-a2370496eccd tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:59 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc Sep 01 08:36:59 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:59 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-73247481-edb8-428f-8b06-a2370496eccd tempest-ProjectReaderTests-991897247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc" returned: 0 in 0.358s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-73247481-edb8-428f-8b06-a2370496eccd tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:59 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc Sep 01 08:36:59 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:36:59 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Sep 01 08:36:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-73247481-edb8-428f-8b06-a2370496eccd tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-173038b7-55ee-40d0-b63e-75bd290fe6cc" returned: 0 in 0.246s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:36:59 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-73247481-edb8-428f-8b06-a2370496eccd tempest-ProjectReaderTests-991897247 None] Lock "cinder-quobyte-173038b7-55ee-40d0-b63e-75bd290fe6cc" released by "delete_volume" :: held 0.659s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:36:59 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-73247481-edb8-428f-8b06-a2370496eccd tempest-ProjectReaderTests-991897247 None] Created reservations ['a047a50c-7f58-4835-92d9-9d0423b942fe', 'e8c683ad-d2f6-40a7-92a1-593f471e3921', 'cbcd65f1-54fa-4791-9d72-29deff5bcd5c', 'c82c8357-cd8f-4a18-b383-b859e33ab4e3'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:36:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-73247481-edb8-428f-8b06-a2370496eccd tempest-ProjectReaderTests-991897247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:36:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-73247481-edb8-428f-8b06-a2370496eccd tempest-ProjectReaderTests-991897247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:36:59 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-73247481-edb8-428f-8b06-a2370496eccd tempest-ProjectReaderTests-991897247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:36:59 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-73247481-edb8-428f-8b06-a2370496eccd tempest-ProjectReaderTests-991897247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:36:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-73247481-edb8-428f-8b06-a2370496eccd tempest-ProjectReaderTests-991897247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:36:59 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-73247481-edb8-428f-8b06-a2370496eccd tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:36:59 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:36:59 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:00 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-73247481-edb8-428f-8b06-a2370496eccd tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.240s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:00 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-73247481-edb8-428f-8b06-a2370496eccd tempest-ProjectReaderTests-991897247 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:37:00 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-73247481-edb8-428f-8b06-a2370496eccd tempest-ProjectReaderTests-991897247 None] Deleted volume successfully. Sep 01 08:37:00 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-73247481-edb8-428f-8b06-a2370496eccd tempest-ProjectReaderTests-991897247 None] Lock "cinder-173038b7-55ee-40d0-b63e-75bd290fe6cc-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:37:00 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:37:00 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] Flow 'volume_create_manager' (c288afe4-4d57-43a2-8eda-36abebf1c852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:37:00 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb268ab3-bb2a-4268-abce-07ca95f2095c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:37:00 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb268ab3-bb2a-4268-abce-07ca95f2095c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1855064228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd1d09e-4a3b-435d-9451-5eb0c96304fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a60627e84a3145989582c813068c707c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:37:01Z,use_quota=True,user_id='34043a6150e84bed87fae68c61152ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:37:00 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa785cbf-6e19-455e-8fe1-48f186c4fdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:37:00 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa785cbf-6e19-455e-8fe1-48f186c4fdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:37:00 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (050abf02-dfbb-4dd0-80ed-2a72b2dc9b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:37:00 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (050abf02-dfbb-4dd0-80ed-2a72b2dc9b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fd1d09e-4a3b-435d-9451-5eb0c96304fd', 'volume_name': 'volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:37:00 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac4744a9-789a-41a5-9293-5088c1ed0ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:37:00 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac4744a9-789a-41a5-9293-5088c1ed0ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:37:00 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d18e00c-f783-44a6-bb77-070f1abd06ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:37:00 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] Volume 7fd1d09e-4a3b-435d-9451-5eb0c96304fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd', 'volume_size': 1} Sep 01 08:37:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:37:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:37:00 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1855064228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd1d09e-4a3b-435d-9451-5eb0c96304fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a60627e84a3145989582c813068c707c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:37:01Z,use_quota=True,user_id='34043a6150e84bed87fae68c61152ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:37:00 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] Creating volume 7fd1d09e-4a3b-435d-9451-5eb0c96304fd {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:37:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:37:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:37:00 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:37:00 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:37:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:37:00 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:37:00 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:37:00 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:37:00 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd 1073741824 Sep 01 08:37:00 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:01 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd 1073741824" returned: 0 in 0.392s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:37:01 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd Sep 01 08:37:01 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:01 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd" returned: 0 in 0.246s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:01 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:37:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:37:01 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d18e00c-f783-44a6-bb77-070f1abd06ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:37:01 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b86aaf-5d46-44c2-a219-2c1f851601b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:37:01 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] Volume volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd (7fd1d09e-4a3b-435d-9451-5eb0c96304fd): created successfully Sep 01 08:37:01 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b86aaf-5d46-44c2-a219-2c1f851601b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:37:01 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] Flow 'volume_create_manager' (c288afe4-4d57-43a2-8eda-36abebf1c852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:37:01 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-762d0b4c-ead6-4ad6-ac3d-2a792e1a6c07 tempest-ProjectReaderTests-991897247 None] Created volume successfully. Sep 01 08:37:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ae8baa6d-dc59-440b-9155-c44c1eed0d77 tempest-ProjectReaderTests-991897247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:37:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ae8baa6d-dc59-440b-9155-c44c1eed0d77 tempest-ProjectReaderTests-991897247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:37:01 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-ae8baa6d-dc59-440b-9155-c44c1eed0d77 tempest-ProjectReaderTests-991897247 None] Creating offline snapshot 6615ac1f-8360-4892-872e-e8062661d8fb of volume 7fd1d09e-4a3b-435d-9451-5eb0c96304fd {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:37:01 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[e045e532-f52e-452f-b77c-00d576cea94c]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:37:01 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ae8baa6d-dc59-440b-9155-c44c1eed0d77 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:37:01 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd Sep 01 08:37:01 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:02 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ae8baa6d-dc59-440b-9155-c44c1eed0d77 tempest-ProjectReaderTests-991897247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd" returned: 0 in 0.353s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ae8baa6d-dc59-440b-9155-c44c1eed0d77 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd.6615ac1f-8360-4892-872e-e8062661d8fb 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:37:02 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd.6615ac1f-8360-4892-872e-e8062661d8fb 1G Sep 01 08:37:02 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:02 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ae8baa6d-dc59-440b-9155-c44c1eed0d77 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd.6615ac1f-8360-4892-872e-e8062661d8fb 1G" returned: 0 in 0.386s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ae8baa6d-dc59-440b-9155-c44c1eed0d77 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd.6615ac1f-8360-4892-872e-e8062661d8fb {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:37:02 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd.6615ac1f-8360-4892-872e-e8062661d8fb Sep 01 08:37:02 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:02 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ae8baa6d-dc59-440b-9155-c44c1eed0d77 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd.6615ac1f-8360-4892-872e-e8062661d8fb" returned: 0 in 0.287s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:02 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-ae8baa6d-dc59-440b-9155-c44c1eed0d77 tempest-ProjectReaderTests-991897247 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd.6615ac1f-8360-4892-872e-e8062661d8fb is being set with open permissions: ugo+rw Sep 01 08:37:02 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ae8baa6d-dc59-440b-9155-c44c1eed0d77 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd.6615ac1f-8360-4892-872e-e8062661d8fb {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:37:02 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd.6615ac1f-8360-4892-872e-e8062661d8fb Sep 01 08:37:02 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:03 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ae8baa6d-dc59-440b-9155-c44c1eed0d77 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd.6615ac1f-8360-4892-872e-e8062661d8fb" returned: 0 in 0.245s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ae8baa6d-dc59-440b-9155-c44c1eed0d77 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:37:03 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd.info Sep 01 08:37:03 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:03 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ae8baa6d-dc59-440b-9155-c44c1eed0d77 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd.info" returned: 0 in 0.251s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:03 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-ae8baa6d-dc59-440b-9155-c44c1eed0d77 tempest-ProjectReaderTests-991897247 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd.info is being set with open permissions: ugo+rw Sep 01 08:37:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ae8baa6d-dc59-440b-9155-c44c1eed0d77 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:37:03 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd.info Sep 01 08:37:03 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:03 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-ae8baa6d-dc59-440b-9155-c44c1eed0d77 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd.info" returned: 0 in 0.263s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:03 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-ae8baa6d-dc59-440b-9155-c44c1eed0d77 tempest-ProjectReaderTests-991897247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.863s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:37:03 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-ae8baa6d-dc59-440b-9155-c44c1eed0d77 tempest-ProjectReaderTests-991897247 None] Create snapshot completed successfully Sep 01 08:37:03 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3fb102f6-0716-483d-893d-6101b01121c9 tempest-ProjectReaderTests-991897247 None] Acquiring lock "cinder-6615ac1f-8360-4892-872e-e8062661d8fb-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:37:03 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3fb102f6-0716-483d-893d-6101b01121c9 tempest-ProjectReaderTests-991897247 None] Lock "cinder-6615ac1f-8360-4892-872e-e8062661d8fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:37:03 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3fb102f6-0716-483d-893d-6101b01121c9 tempest-ProjectReaderTests-991897247 None] Acquiring lock "cinder-quobyte-7fd1d09e-4a3b-435d-9451-5eb0c96304fd" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:37:04 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3fb102f6-0716-483d-893d-6101b01121c9 tempest-ProjectReaderTests-991897247 None] Lock "cinder-quobyte-7fd1d09e-4a3b-435d-9451-5eb0c96304fd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:37:04 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3fb102f6-0716-483d-893d-6101b01121c9 tempest-ProjectReaderTests-991897247 None] Acquiring lock "cinder-quobyte-6615ac1f-8360-4892-872e-e8062661d8fb" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:37:04 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3fb102f6-0716-483d-893d-6101b01121c9 tempest-ProjectReaderTests-991897247 None] Lock "cinder-quobyte-6615ac1f-8360-4892-872e-e8062661d8fb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:37:04 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-3fb102f6-0716-483d-893d-6101b01121c9 tempest-ProjectReaderTests-991897247 None] Deleting offline snapshot 6615ac1f-8360-4892-872e-e8062661d8fb of volume 7fd1d09e-4a3b-435d-9451-5eb0c96304fd {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:37:04 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-3fb102f6-0716-483d-893d-6101b01121c9 tempest-ProjectReaderTests-991897247 None] snapshot_file for this snap is: volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd.6615ac1f-8360-4892-872e-e8062661d8fb {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:37:04 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[504f982e-334b-4242-af7a-4475c93f339f]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:37:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3fb102f6-0716-483d-893d-6101b01121c9 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd.6615ac1f-8360-4892-872e-e8062661d8fb {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:37:04 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd.6615ac1f-8360-4892-872e-e8062661d8fb Sep 01 08:37:04 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:04 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3fb102f6-0716-483d-893d-6101b01121c9 tempest-ProjectReaderTests-991897247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd.6615ac1f-8360-4892-872e-e8062661d8fb" returned: 0 in 0.364s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:04 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-3fb102f6-0716-483d-893d-6101b01121c9 tempest-ProjectReaderTests-991897247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:37:04 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f20d643-77d8-490e-b8f2-5c934e65541e]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:37:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3fb102f6-0716-483d-893d-6101b01121c9 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:37:04 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd Sep 01 08:37:04 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:04 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3fb102f6-0716-483d-893d-6101b01121c9 tempest-ProjectReaderTests-991897247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd" returned: 0 in 0.373s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:04 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3fb102f6-0716-483d-893d-6101b01121c9 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd.6615ac1f-8360-4892-872e-e8062661d8fb {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:37:04 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd.6615ac1f-8360-4892-872e-e8062661d8fb Sep 01 08:37:04 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:05 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3fb102f6-0716-483d-893d-6101b01121c9 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd.6615ac1f-8360-4892-872e-e8062661d8fb" returned: 0 in 0.327s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3fb102f6-0716-483d-893d-6101b01121c9 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd.6615ac1f-8360-4892-872e-e8062661d8fb {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:37:05 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd.6615ac1f-8360-4892-872e-e8062661d8fb Sep 01 08:37:05 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:05 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:05 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3fb102f6-0716-483d-893d-6101b01121c9 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd.6615ac1f-8360-4892-872e-e8062661d8fb" returned: 0 in 0.244s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:05 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3fb102f6-0716-483d-893d-6101b01121c9 tempest-ProjectReaderTests-991897247 None] Lock "cinder-quobyte-6615ac1f-8360-4892-872e-e8062661d8fb" released by "_delete_snapshot" :: held 1.395s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:37:05 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3fb102f6-0716-483d-893d-6101b01121c9 tempest-ProjectReaderTests-991897247 None] Lock "cinder-quobyte-7fd1d09e-4a3b-435d-9451-5eb0c96304fd" released by "delete_snapshot" :: held 1.418s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:37:05 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-3fb102f6-0716-483d-893d-6101b01121c9 tempest-ProjectReaderTests-991897247 None] Created reservations ['5807139d-8580-4a31-afd7-138745cdc6f8', '1ac27cd9-a36a-4fbb-a1b2-4ffccdaa05fc', '40825d62-f45f-4872-83dc-bff84c12de24', 'dc9906f6-8e14-4792-a142-44688f74649c'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:37:05 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-3fb102f6-0716-483d-893d-6101b01121c9 tempest-ProjectReaderTests-991897247 None] Delete snapshot completed successfully. Sep 01 08:37:05 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-3fb102f6-0716-483d-893d-6101b01121c9 tempest-ProjectReaderTests-991897247 None] Lock "cinder-6615ac1f-8360-4892-872e-e8062661d8fb-delete_snapshot" released by "delete_snapshot" :: held 1.561s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:37:06 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-566295a9-8315-4355-8066-a31cd600ae40 tempest-ProjectReaderTests-991897247 None] Acquiring lock "cinder-7fd1d09e-4a3b-435d-9451-5eb0c96304fd-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:37:06 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-566295a9-8315-4355-8066-a31cd600ae40 tempest-ProjectReaderTests-991897247 None] Lock "cinder-7fd1d09e-4a3b-435d-9451-5eb0c96304fd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:37:06 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-566295a9-8315-4355-8066-a31cd600ae40 tempest-ProjectReaderTests-991897247 None] Acquiring lock "cinder-quobyte-7fd1d09e-4a3b-435d-9451-5eb0c96304fd" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:37:06 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-566295a9-8315-4355-8066-a31cd600ae40 tempest-ProjectReaderTests-991897247 None] Lock "cinder-quobyte-7fd1d09e-4a3b-435d-9451-5eb0c96304fd" acquired by "delete_volume" :: waited 0.014s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:37:06 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2881d83-803d-4e34-8415-c79f629d9885]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:37:06 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-566295a9-8315-4355-8066-a31cd600ae40 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:37:06 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd Sep 01 08:37:06 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:06 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:06 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-566295a9-8315-4355-8066-a31cd600ae40 tempest-ProjectReaderTests-991897247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd" returned: 0 in 0.354s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:06 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-566295a9-8315-4355-8066-a31cd600ae40 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:37:06 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd Sep 01 08:37:06 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:06 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:06 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-566295a9-8315-4355-8066-a31cd600ae40 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-7fd1d09e-4a3b-435d-9451-5eb0c96304fd" returned: 0 in 0.262s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:06 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-566295a9-8315-4355-8066-a31cd600ae40 tempest-ProjectReaderTests-991897247 None] Lock "cinder-quobyte-7fd1d09e-4a3b-435d-9451-5eb0c96304fd" released by "delete_volume" :: held 0.668s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:37:06 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-566295a9-8315-4355-8066-a31cd600ae40 tempest-ProjectReaderTests-991897247 None] Created reservations ['481be721-1f6a-4bc8-a0cd-b05e5ab03697', '75e29858-b7b0-41a0-a788-2cc005bf5e63', '02d39da2-5d4f-4746-914a-d5d9bd9785d1', '345c050a-5ba8-455c-9afb-9d17d3fe9561'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:37:06 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-566295a9-8315-4355-8066-a31cd600ae40 tempest-ProjectReaderTests-991897247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:37:06 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-566295a9-8315-4355-8066-a31cd600ae40 tempest-ProjectReaderTests-991897247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:37:06 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-566295a9-8315-4355-8066-a31cd600ae40 tempest-ProjectReaderTests-991897247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:37:06 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-566295a9-8315-4355-8066-a31cd600ae40 tempest-ProjectReaderTests-991897247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:37:06 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-566295a9-8315-4355-8066-a31cd600ae40 tempest-ProjectReaderTests-991897247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:37:06 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-566295a9-8315-4355-8066-a31cd600ae40 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:37:07 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:37:07 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:07 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-566295a9-8315-4355-8066-a31cd600ae40 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.252s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:07 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-566295a9-8315-4355-8066-a31cd600ae40 tempest-ProjectReaderTests-991897247 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:37:07 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-566295a9-8315-4355-8066-a31cd600ae40 tempest-ProjectReaderTests-991897247 None] Deleted volume successfully. Sep 01 08:37:07 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-566295a9-8315-4355-8066-a31cd600ae40 tempest-ProjectReaderTests-991897247 None] Lock "cinder-7fd1d09e-4a3b-435d-9451-5eb0c96304fd-delete_volume" released by "delete_volume" :: held 1.112s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:37:07 devstack cinder-volume[86893]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1406}} Sep 01 08:37:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] Flow 'volume_create_manager' (e6f5c610-f02c-4c3f-969e-17bbd40d5e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:37:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62498d26-e8a4-4266-ad62-99f69e93fede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:37:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62498d26-e8a4-4266-ad62-99f69e93fede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2115003238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3791ac6-7b41-497a-9a4d-b8e71618f39f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a60627e84a3145989582c813068c707c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:37:08Z,use_quota=True,user_id='34043a6150e84bed87fae68c61152ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:37:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e3b4af-edce-4385-9f6a-63a6abaaec43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:37:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e3b4af-edce-4385-9f6a-63a6abaaec43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:37:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f3f5016-c61b-47db-9153-2b41ccc005ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:37:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f3f5016-c61b-47db-9153-2b41ccc005ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3791ac6-7b41-497a-9a4d-b8e71618f39f', 'volume_name': 'volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:37:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7997fd4-d395-4594-a8dc-379b60a81cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:37:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7997fd4-d395-4594-a8dc-379b60a81cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:37:07 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd3cc95-4ba6-4dd2-b1f4-9d50c42d6c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:37:07 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] Volume a3791ac6-7b41-497a-9a4d-b8e71618f39f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f', 'volume_size': 1} Sep 01 08:37:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:37:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:37:07 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T06:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2115003238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3791ac6-7b41-497a-9a4d-b8e71618f39f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a60627e84a3145989582c813068c707c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T06:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T06:37:08Z,use_quota=True,user_id='34043a6150e84bed87fae68c61152ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1fdc4298-caaf-4888-82ce-f010dbebe54b),volume_type_id=1fdc4298-caaf-4888-82ce-f010dbebe54b)}" {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 08:37:07 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] Creating volume a3791ac6-7b41-497a-9a4d-b8e71618f39f {{(pid=86893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 08:37:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:37:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:37:07 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:37:07 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:37:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:37:07 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] Selected osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 as target Quobyte volume. {{(pid=86893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 08:37:07 devstack cinder-volume[86893]: INFO cinder.volume.drivers.remotefs [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] casted to osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049 Sep 01 08:37:07 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f 1073741824 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:37:07 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f 1073741824 Sep 01 08:37:07 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:08 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f 1073741824" returned: 0 in 0.397s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:37:08 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f Sep 01 08:37:08 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:08 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f" returned: 0 in 0.239s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:08 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'} {{(pid=86893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 08:37:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:37:08 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd3cc95-4ba6-4dd2-b1f4-9d50c42d6c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f', 'volume_size': 1}' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:37:08 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff35b775-861b-4c84-a393-08b6e8f956a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 08:37:08 devstack cinder-volume[86893]: INFO cinder.volume.flows.manager.create_volume [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] Volume volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f (a3791ac6-7b41-497a-9a4d-b8e71618f39f): created successfully Sep 01 08:37:08 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff35b775-861b-4c84-a393-08b6e8f956a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86893) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 08:37:08 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] Flow 'volume_create_manager' (e6f5c610-f02c-4c3f-969e-17bbd40d5e04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86893) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 08:37:08 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-0e95ef86-e3a6-431b-ba5a-165837784bb2 tempest-ProjectReaderTests-991897247 None] Created volume successfully. Sep 01 08:37:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3657f3ff-acf4-464e-b2a1-56852eaf88f7 tempest-ProjectReaderTests-991897247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:37:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3657f3ff-acf4-464e-b2a1-56852eaf88f7 tempest-ProjectReaderTests-991897247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:37:08 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-3657f3ff-acf4-464e-b2a1-56852eaf88f7 tempest-ProjectReaderTests-991897247 None] Creating offline snapshot f82ccad9-d182-4b82-8dab-1628de5de36e of volume a3791ac6-7b41-497a-9a4d-b8e71618f39f {{(pid=86893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 08:37:08 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[7039cf0d-44de-4add-a8dc-dff84225ffb7]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:37:08 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3657f3ff-acf4-464e-b2a1-56852eaf88f7 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:37:09 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f Sep 01 08:37:09 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:09 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3657f3ff-acf4-464e-b2a1-56852eaf88f7 tempest-ProjectReaderTests-991897247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f" returned: 0 in 0.355s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3657f3ff-acf4-464e-b2a1-56852eaf88f7 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f.f82ccad9-d182-4b82-8dab-1628de5de36e 1G {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:37:09 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f.f82ccad9-d182-4b82-8dab-1628de5de36e 1G Sep 01 08:37:09 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:09 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3657f3ff-acf4-464e-b2a1-56852eaf88f7 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f.f82ccad9-d182-4b82-8dab-1628de5de36e 1G" returned: 0 in 0.376s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3657f3ff-acf4-464e-b2a1-56852eaf88f7 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f.f82ccad9-d182-4b82-8dab-1628de5de36e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:37:09 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f.f82ccad9-d182-4b82-8dab-1628de5de36e Sep 01 08:37:09 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:09 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3657f3ff-acf4-464e-b2a1-56852eaf88f7 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f -F qcow2 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f.f82ccad9-d182-4b82-8dab-1628de5de36e" returned: 0 in 0.296s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:09 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-3657f3ff-acf4-464e-b2a1-56852eaf88f7 tempest-ProjectReaderTests-991897247 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f.f82ccad9-d182-4b82-8dab-1628de5de36e is being set with open permissions: ugo+rw Sep 01 08:37:09 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3657f3ff-acf4-464e-b2a1-56852eaf88f7 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f.f82ccad9-d182-4b82-8dab-1628de5de36e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:37:10 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f.f82ccad9-d182-4b82-8dab-1628de5de36e Sep 01 08:37:10 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:10 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3657f3ff-acf4-464e-b2a1-56852eaf88f7 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f.f82ccad9-d182-4b82-8dab-1628de5de36e" returned: 0 in 0.239s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:10 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=102,cinder:INSERT=40,cinder:UPDATE=154,cinder:DELETE=13 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:37:10 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=125,cinder:UPDATE=136,cinder:DELETE=11,cinder:INSERT=40 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:37:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3657f3ff-acf4-464e-b2a1-56852eaf88f7 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:37:10 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f.info Sep 01 08:37:10 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:10 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3657f3ff-acf4-464e-b2a1-56852eaf88f7 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f.info" returned: 0 in 0.247s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:10 devstack cinder-volume[86893]: WARNING cinder.volume.drivers.remotefs [None req-3657f3ff-acf4-464e-b2a1-56852eaf88f7 tempest-ProjectReaderTests-991897247 None] /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f.info is being set with open permissions: ugo+rw Sep 01 08:37:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3657f3ff-acf4-464e-b2a1-56852eaf88f7 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f.info {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:37:10 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f.info Sep 01 08:37:10 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:10 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-3657f3ff-acf4-464e-b2a1-56852eaf88f7 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f.info" returned: 0 in 0.255s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:10 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-3657f3ff-acf4-464e-b2a1-56852eaf88f7 tempest-ProjectReaderTests-991897247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.848s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:37:10 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-3657f3ff-acf4-464e-b2a1-56852eaf88f7 tempest-ProjectReaderTests-991897247 None] Create snapshot completed successfully Sep 01 08:37:11 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-233638a4-33ef-4b39-8852-72d43eb58a32 tempest-ProjectReaderTests-991897247 None] Acquiring lock "cinder-f82ccad9-d182-4b82-8dab-1628de5de36e-delete_snapshot" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:37:11 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-233638a4-33ef-4b39-8852-72d43eb58a32 tempest-ProjectReaderTests-991897247 None] Lock "cinder-f82ccad9-d182-4b82-8dab-1628de5de36e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:37:11 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-233638a4-33ef-4b39-8852-72d43eb58a32 tempest-ProjectReaderTests-991897247 None] Acquiring lock "cinder-quobyte-a3791ac6-7b41-497a-9a4d-b8e71618f39f" by "delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:37:11 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-233638a4-33ef-4b39-8852-72d43eb58a32 tempest-ProjectReaderTests-991897247 None] Lock "cinder-quobyte-a3791ac6-7b41-497a-9a4d-b8e71618f39f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:37:11 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-233638a4-33ef-4b39-8852-72d43eb58a32 tempest-ProjectReaderTests-991897247 None] Acquiring lock "cinder-quobyte-f82ccad9-d182-4b82-8dab-1628de5de36e" by "_delete_snapshot" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:37:11 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-233638a4-33ef-4b39-8852-72d43eb58a32 tempest-ProjectReaderTests-991897247 None] Lock "cinder-quobyte-f82ccad9-d182-4b82-8dab-1628de5de36e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:37:11 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-233638a4-33ef-4b39-8852-72d43eb58a32 tempest-ProjectReaderTests-991897247 None] Deleting offline snapshot f82ccad9-d182-4b82-8dab-1628de5de36e of volume a3791ac6-7b41-497a-9a4d-b8e71618f39f {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 08:37:11 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-233638a4-33ef-4b39-8852-72d43eb58a32 tempest-ProjectReaderTests-991897247 None] snapshot_file for this snap is: volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f.f82ccad9-d182-4b82-8dab-1628de5de36e {{(pid=86893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 08:37:11 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f08bd14-d098-4bc6-97fe-5694dbd3d9a6]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:37:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-233638a4-33ef-4b39-8852-72d43eb58a32 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f.f82ccad9-d182-4b82-8dab-1628de5de36e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:37:11 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f.f82ccad9-d182-4b82-8dab-1628de5de36e Sep 01 08:37:11 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:11 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-233638a4-33ef-4b39-8852-72d43eb58a32 tempest-ProjectReaderTests-991897247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f.f82ccad9-d182-4b82-8dab-1628de5de36e" returned: 0 in 0.350s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:11 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.remotefs [None req-233638a4-33ef-4b39-8852-72d43eb58a32 tempest-ProjectReaderTests-991897247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 08:37:11 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[912c5411-63b4-4cca-9f4f-ec7fc1a10414]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:37:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-233638a4-33ef-4b39-8852-72d43eb58a32 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:37:11 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f Sep 01 08:37:11 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:11 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-233638a4-33ef-4b39-8852-72d43eb58a32 tempest-ProjectReaderTests-991897247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f" returned: 0 in 0.356s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:11 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-233638a4-33ef-4b39-8852-72d43eb58a32 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f.f82ccad9-d182-4b82-8dab-1628de5de36e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:37:11 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f.f82ccad9-d182-4b82-8dab-1628de5de36e Sep 01 08:37:11 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:12 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-233638a4-33ef-4b39-8852-72d43eb58a32 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f.f82ccad9-d182-4b82-8dab-1628de5de36e" returned: 0 in 0.341s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-233638a4-33ef-4b39-8852-72d43eb58a32 tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f.f82ccad9-d182-4b82-8dab-1628de5de36e {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:37:12 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f.f82ccad9-d182-4b82-8dab-1628de5de36e Sep 01 08:37:12 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:12 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:12 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-233638a4-33ef-4b39-8852-72d43eb58a32 tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f.f82ccad9-d182-4b82-8dab-1628de5de36e" returned: 0 in 0.244s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:12 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-233638a4-33ef-4b39-8852-72d43eb58a32 tempest-ProjectReaderTests-991897247 None] Lock "cinder-quobyte-f82ccad9-d182-4b82-8dab-1628de5de36e" released by "_delete_snapshot" :: held 1.381s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:37:12 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-233638a4-33ef-4b39-8852-72d43eb58a32 tempest-ProjectReaderTests-991897247 None] Lock "cinder-quobyte-a3791ac6-7b41-497a-9a4d-b8e71618f39f" released by "delete_snapshot" :: held 1.404s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:37:12 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-233638a4-33ef-4b39-8852-72d43eb58a32 tempest-ProjectReaderTests-991897247 None] Created reservations ['6b65c384-bb9d-42f3-aa2b-eb46aeeb3716', '8b118a77-4912-4a2f-be88-56546c7e8c03', '9ecbf3e2-eb0a-4c6b-9620-cca8502a0c07', 'c8aaee84-82d1-4aab-b5eb-0f0220789532'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:37:12 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-233638a4-33ef-4b39-8852-72d43eb58a32 tempest-ProjectReaderTests-991897247 None] Delete snapshot completed successfully. Sep 01 08:37:12 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-233638a4-33ef-4b39-8852-72d43eb58a32 tempest-ProjectReaderTests-991897247 None] Lock "cinder-f82ccad9-d182-4b82-8dab-1628de5de36e-delete_snapshot" released by "delete_snapshot" :: held 1.532s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:37:13 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4dff0d38-f178-499b-831a-2ff5da4b483e tempest-ProjectReaderTests-991897247 None] Acquiring lock "cinder-a3791ac6-7b41-497a-9a4d-b8e71618f39f-delete_volume" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:37:13 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4dff0d38-f178-499b-831a-2ff5da4b483e tempest-ProjectReaderTests-991897247 None] Lock "cinder-a3791ac6-7b41-497a-9a4d-b8e71618f39f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:37:13 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4dff0d38-f178-499b-831a-2ff5da4b483e tempest-ProjectReaderTests-991897247 None] Acquiring lock "cinder-quobyte-a3791ac6-7b41-497a-9a4d-b8e71618f39f" by "delete_volume" {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 08:37:13 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4dff0d38-f178-499b-831a-2ff5da4b483e tempest-ProjectReaderTests-991897247 None] Lock "cinder-quobyte-a3791ac6-7b41-497a-9a4d-b8e71618f39f" acquired by "delete_volume" :: waited 0.014s {{(pid=86893) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 08:37:13 devstack cinder-volume[86893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15a2c04-6818-4608-9a73-708fa3ed20f0]: (4, 'qcow2') {{(pid=88145) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 08:37:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4dff0d38-f178-499b-831a-2ff5da4b483e tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:37:13 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f Sep 01 08:37:13 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:13 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4dff0d38-f178-499b-831a-2ff5da4b483e tempest-ProjectReaderTests-991897247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f" returned: 0 in 0.354s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4dff0d38-f178-499b-831a-2ff5da4b483e tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:37:13 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f Sep 01 08:37:13 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:13 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:13 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4dff0d38-f178-499b-831a-2ff5da4b483e tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10/volume-a3791ac6-7b41-497a-9a4d-b8e71618f39f" returned: 0 in 0.242s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:13 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4dff0d38-f178-499b-831a-2ff5da4b483e tempest-ProjectReaderTests-991897247 None] Lock "cinder-quobyte-a3791ac6-7b41-497a-9a4d-b8e71618f39f" released by "delete_volume" :: held 0.647s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:37:13 devstack cinder-volume[86893]: DEBUG cinder.quota [None req-4dff0d38-f178-499b-831a-2ff5da4b483e tempest-ProjectReaderTests-991897247 None] Created reservations ['867839c0-8572-4ecd-a19a-3784da5a374c', '95af3e89-42c1-448e-86b1-79a7a0864ec4', '7c9d3547-b72c-4d55-b9e9-e697eb3dfce5', '725d59df-703a-4487-9318-4a7c0355b7a1'] {{(pid=86893) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 08:37:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4dff0d38-f178-499b-831a-2ff5da4b483e tempest-ProjectReaderTests-991897247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:37:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4dff0d38-f178-499b-831a-2ff5da4b483e tempest-ProjectReaderTests-991897247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:37:14 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4dff0d38-f178-499b-831a-2ff5da4b483e tempest-ProjectReaderTests-991897247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:37:14 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-4dff0d38-f178-499b-831a-2ff5da4b483e tempest-ProjectReaderTests-991897247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:37:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-4dff0d38-f178-499b-831a-2ff5da4b483e tempest-ProjectReaderTests-991897247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:37:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4dff0d38-f178-499b-831a-2ff5da4b483e tempest-ProjectReaderTests-991897247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:37:14 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:37:14 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:14 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:14 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-4dff0d38-f178-499b-831a-2ff5da4b483e tempest-ProjectReaderTests-991897247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.248s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:14 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-4dff0d38-f178-499b-831a-2ff5da4b483e tempest-ProjectReaderTests-991897247 None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:37:14 devstack cinder-volume[86893]: INFO cinder.volume.manager [None req-4dff0d38-f178-499b-831a-2ff5da4b483e tempest-ProjectReaderTests-991897247 None] Deleted volume successfully. Sep 01 08:37:14 devstack cinder-volume[86893]: DEBUG cinder.coordination [None req-4dff0d38-f178-499b-831a-2ff5da4b483e tempest-ProjectReaderTests-991897247 None] Lock "cinder-a3791ac6-7b41-497a-9a4d-b8e71618f39f-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=86893) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 08:37:24 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=7,cinder:INSERT=5,cinder:DELETE=1,cinder:UPDATE=16 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:37:24 devstack cinder-volume[86893]: DEBUG dbcounter [-] [86893] Writing DB stats cinder:SELECT=14,cinder:UPDATE=12,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 08:37:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:37:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 08:37:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 08:37:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049': None} {{(pid=86893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 08:37:31 devstack cinder-volume[86893]: DEBUG cinder.volume.drivers.quobyte [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-147bbe67-9a6f-493e-b3c9-8bd6d6b7d049'] {{(pid=86893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 08:37:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.lockutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86893) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 08:37:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 08:37:31 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10 Sep 01 08:37:31 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 08:37:31 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Sep 01 08:37:31 devstack cinder-volume[86893]: DEBUG oslo_concurrency.processutils [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2167e92d7f4711974f7eb614fbaf4f10" returned: 0 in 0.241s {{(pid=86893) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 08:37:31 devstack cinder-volume[86893]: DEBUG cinder.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Notifying Schedulers of capabilities ... {{(pid=86893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 08:37:31 devstack cinder-volume[86893]: DEBUG oslo_service.periodic_task [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] Running periodic task VolumeManager._thread_info {{(pid=86893) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 08:37:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread count: 28 {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 08:37:31 devstack cinder-volume[86893]: DEBUG cinder.volume.manager [None req-f1860e27-5739-4f06-86ef-36e510e0b2a0 None None] thread info: [<_MainThread(MainThread, started 138934582050944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86893) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}